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Preface 


The  purpose  of  this  report  is  to  provido  a  record  of  the  research  on 
pilot  training  conducted  by  aviation  psychologists  under  tho  Offico 
of  tho  Surgeon  in  tho  AAF  Training  Command.  It  has  been  prepared 
in  compliance  with  directives  from  Headquarters,  Army  Air  Forces, 
and  Headquarters,  Training  Command.  No  attempt  is  mado  to  givo 
comprehensive  references  to  psychological  research  conducted  outsido 
of  the  AAF  Training  Command  bccauso  most  of  that  work  has  not 
yet  been  officially  published.  The  final  chapter  (No.  15)  is  a  summary 
presented  for  the  benefit  of  thoso  readers  who  are  more  interested  in 
an  integrated  picturo  of  tho  main  results  than  in  the  technical  dotails 
of  the  separate  studies. 

Most  of  the  research  summarized  in  this  report  was  conducted  by 
Psychological  Research  Project  (Pilot),  an  oignnization  which  was 
established  and  mado  responsible  for  psychological  research  on  pilot 
training  on  1  Februniy  1944.  A  smaller  but  important  amount  of 
research  was  performed  by  other  psychological  units. 

Tho  research  which  is  reported  could  not  havo  been  conducted  with¬ 
out  tho  strong  support  of  higher  headquarters,  and  especially  from 
tho  aviation  psychologists  in  Headquarters,  Army  Air  Forces,  and 
Headquarters,  Training  Command.  Valuablo  assistance  has  been 
received  from  tho  Surgeon,  the  Pilot  Section  of  tho  A-3  Division,  and 
tho  Statistical  Control  Unit  at  Central  Flying  Training  Command; 
tho  Director  of  Training  ai  d  Training  Advisory  Boards  of  tho  Central 
Instructors  School  at  Randolph  Field;  and  the  Director  of  Training 
and  Standardization  Boards  at  tho  Instrument  Pilot  School  at  Bryan. 
During  tho  crucial  initial  stages  of  the  development  of  Psychological 
Research  Project  (Pilot),  particularly  helpful,  insightful  support  was 
received  from  tho  following  officers  in  tho  Central  Instructors  School 
at  Randolph  Field:  Maj.  Charles  II.  Roadman,  Director  of  tho  Ground 
School;  Lt.  Col.  Charles  M.  Wharton,  Commanding  Officer  of  tho 
Bomber  Training  Group;  and  Col.  Merill  J.  Reel),  Surgeon.  Pilots 
from  a  number  of  different  organizations  havo  supplied  expert  advico 
and  criticism  on  tho  technical  aspects  of  flying.  Tho  organizations 
which  wero  the  chief  sources  of  such  assistance  are  listed  immediately 
following  this  prcfaco. 

Tho  research  reported  represents  the  cooperative,  creativo  work  of 
a  number  of  psychologists.  A  roster  of  personnel  who  lmvo  worked 
in  tho  Pilot  Project  precedes  the  table  of  Contents  of  this  report. 
Particular  noto  should  bo  made  of  the  fact  that  the  lower  army  status 
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of  the  enlisted  men  did  not  necessarily  mean  that  their  work  was  of 
lower  professional  calibre. 

The  authors,  whoso  names  appear  at  the  head  of  each  chapter,  were 
responsible  for  the  supervision  of  most  of  the  work  reported  in  their 
chapters,  with  tho  exception  of  Captain  Ben-Avi  who  was  given  the 
difficult  task  of  reporting  work  with  which  ho  had  no  first-hand 
contact.  Although  it  is  difficult  to  assign  credit  equitably  for  cooper¬ 
ative  work  of  this  kind,  an  attempt  has  been  mado  to  cito  the  chief 
contributors  to  each  of  the  research  studies  reported. 

Six  men  deserve  special  mention  hero  bccauso  their  contributions 
were  of  u  general  naturo  which  is  not  credited  in  tho  individual  studies. 
Sgt.  Allen  J.  Sprow  performed  an  excellent  job  of  writing  the  semi¬ 
monthly  reports  summarizing  tho  research  of  tho  Pilot  Project  and  of 
assisting  with  tho  annual  reports.  This  work,  which  required  insight 
into  all  of  tho  research  involved,  left  no  timo  freo  for  conducting  studies 
of  his  own.  T/Sgt.  Robert  It.  Blako  was  so  useful  as  a  general  ad¬ 
ministrative  assistant  in  roles  ranging  from  liaison  with  other  organi¬ 
zations  on  tho  field  and  establishing  filing  systems,  through  that  of 
serving  as  a  general  critic  and  conscience,  that  ho  was  given  little 
timo  for  nnylhing  else.  Similar  capable  scrvico  in  a  number  of  ad¬ 
ministrative  roles  was  rendered  by  T/Sgt.  Robert  E.  Dixon.  During 
his  threo  months  with  tho  Pilot  Project,  Lt.  Maurico  Dcigh  displayed 
initiative  and  resourcefulness  in  dealing  with  problems  of  supply 
and  assisting  in  many  of  tho  administrative  details  involved  in  tha 
preparation  of  this  report.  In  tho  final  stages  of  tho  preparation  of 
tho  manuscript  intelligent  help  was  received  from  Dr.  John  T.  Cowles 
and  Capt.  John  T.  Dailey,  tho  now  Director  and  Assistant  Director 
of  tho  Pilot  Project. 

Neal  E.  Miller,  Major ,  Air  Corps. 
Randolph  Field,  Tex.,  11  February  1M8. 
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Organizations  Supplying  Tech¬ 
nical  Consultants 

AAF  Board,  AAF  Tactical  Center. 

AAF  Instrument  Flying  Standardization  Board,  Bryan  Army  Air 
Field. 

AAF  School  of  Applied  Tactics,  AAF  Tactical  Center. 

Advanced  Singlo-Engino  Training  Advisory  Board,  Central  Instructors 
School  (Pilot),  Randolph  Field. 

Advanced  Two-Engino  Training  Advisoiy  Board,  Central  Instructors 
School  (Pilot),  Randolph  Field. 

Basic  Training  Advisory  Board,  Central  Instructors  School  (Pilot), 
Randolph  Field. 

Flight  Test  Section,  Proving  Ground  Command,  Eglin  Field. 

Ground  School,  Lockbourno  Army  Air  Boso  (Pilot  Instructors  School, 

B-n). 

Ground  School,  Smyrna  Army  Air  Field  (Pilot  Instructors  School, 

B-24). 

Ground  Training  Technical  Advisory  Department,  Central  Instructors 
School  (Pilot),  Randolph  Field. 

Instrument  Board,  Central  Instructors  School  (Pilot),  Randolph  Field. 

Instrument  Training  Squadron,  Pompa  Army  Air  Field. 

Offico  of  Flying  Safety. 

Physiological  Section,  Proving  Ground  Command,  Eglin  Field. 

Physiology  Department,  School  of  Aviation  Mcdicino,  Randolph  Field. 

Pilot  Section,  A-3  Division,  Headquarters,  AAF  Central  Flying  . 
Training  Command,  Randolph  Field. 

Pilot  Section,  A-3  Division,  Headquarters,  AAF  Training  Command, 
Fort  Worth. 

Primary  Training  Advisory  Board,  Central  Instructors  School  (Pilot), 
Randolph  Field. 

Station  Standardization  Board,  Instructors  School  (Instrument  Pilot), 
Bryan  Army  Air  Field. 
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CHAPTER  ONE 


Areas  and  Conditions  of 
Research 

Maj.  Neal  E.  Miller 


INTRODUCTION 

« 

Purpose  of  Report 

This  report  is  written  ns  n  record  of  tho  research  on  pilot  training 
conducted  during  the  second  World  War  by  aviation  psychologists  in 
tho  AAF  Training  Command.  It  is  ono  of  a  series  dealing  with  the 
various  types  of  wartime  psychological  research  under  tho  direction 
of  tho  Office  of  the  Air  Surgeon. 

Tho  two  chapters  following  this  ono  present  ft  sketch  of  tho  pilot- 
training  program  and  a  description  of  the  tnsk  of  learning  to  fly.  Thoy 
will  serve  as  a  background  for  understanding  tho  research  reported. 
Tho  main  body  of  tho  report,  chapters  4  through  14,  is  intended  to  bo 
a  source  of  technical  information  concerning  tho  procedures  and  results 
of  psychological  research  on  pilot  training  during  tho  war.  Tho  final 
chapter  summarizes  tho  main  highlights  for  thoso  renders  who  nro  more 
interested  in  tho  chief  conclusions  than  in  technical  details,  or  who 
want  to  get  a  perspective  beforo  immersing  themselves  in  tho  separate 
studies.  A  glossary  of  military,  aeronautical,  and  statistical  terms  is 
included  at  tho  end  of  tho  report. 

Gradual  Development  of  Opportunity  for  Psychological  Research  on 
Training 

Aviation  psychologists  were  originnlly  called  into  tho  Air  Forces 
to  construct  tests  for  the  selection  and  classification  of  pilots,  bom¬ 
bardiers,  and  navigators.  During  the  first  years  of  tho  war  their 
efforts  wero  almost  entirely  devoted  to  developing  and  administering 
these  tests.  Research  on  training  developed  gradually  out  of  this 
original  work  on  selection  and  classification.  Tho  threo  lines  of  work 
lending  from  classification  into  training  wero:  (1)  Job  analysis  studies 
conducted  to  provido  a  basis  for  test  development;  (2)  investigations 
of  measures  of  flying  proficiency  conducted  to  learn  moro  about  tho 
criteria  available  for  validating  tho  aptitude  tests;  and  (3)  attempts  to 
apply  tho  techniques  used  successfully  in  developing  a  battery  of 
pilot-selection  tests  to  tho  problem  of  instructor  selection. 

From  tho  very  first,  a  number  of  aviation  psychologists  tried  to  visit 
pilot  training  schools  and  obtain  somo  flying  training  in  order  to  bo 
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able  to  mnkc  first-hand,  job-analysis  observations  as  a  basis  for  de¬ 
veloping'  the  pilot  aptitude  tests.  Because  of  the  pressure  of  developing 
an  extensive  buttery  of  aptitude  tests  quickly  and  administering  them 
to  ever-increasing  numbers  of  students  in  the  emergency  and  because 
of  certain  administrative  difficulties,  it  was  not  until  early  in  1943 
that  an  opportunity  was  .inully  secured  for  two  officers  to  spend  6 
weeks  at  a  pilot  truining  school  and  to  receive  a  certain  amount  of 
flying  training.1 

At  the  same  time,  studies  were  being  made  of  the  criteria  used  to 
validate  the  pilot  aptitude  tests.  The  three  original  psychological 
research  units  made  statistical  studies  of  the  pass-fail  criterion,  in¬ 
vestigating  the  variability  of  elimination  rates  at  different  schools. 
The  Field  Studies  Unit,  Psychological  Section,  Headquarters,  Training 
Command,  visited  schools  in  the  spring  and  summer  of  1942  to  intro¬ 
duce  a  rating  scale  which  was  designed  in  an  attempt  to  get  more 
specific  measures  of  various  aspects  of  pilot  performance  to  use  as 
differential  criteria  in  validating  aptitude  tests.* 

As  validation  data  accumulated,  demonstrating  that  the  aptitude 
tests  were  successful  in  selecting  those  students  who  were  least  likely 
to  bo  eliminated  for  flying  deficiency,  the  individuals  responsible  for 
pilot  training  tended  to  seek  the  aid  of  aviation  psychologists  on  other 
problems.  Officers  at  Psychological  Research  Unit  No.  2  *  were  asked 
to  try  to  develop  a  battery  of  tests  for  the  selection  of  civilian  flying 
instructors  who  wero  to  be  employed  in  Primary  schools. 

Meanwhile  a  research  detachment  which  originally  had  been  sent 
to  n  Gunnery  Instructors  School  to  work  on  the  selection  of  flexible 
gunners  had  grown  into  a  full-fledged  Unit  and  attracted  considerable 
attention  by  tho  technical  assistance  which  it  was  giving  to  the 
gunnery  training  progrnm. 

Furthermore,  a  staff  study  in  Headquarters,  Army  Air  Forces 
recommended  that  aviation  psychologists  bo  used  for  research  on 
training  ns  well  ns  on  selection. 

These  developments  finally  led  to  the  establishment  on  1  February 
1944  of  an  organization,  the  Psychological  Research  Project  (Pilot), 
which  was  eventually  gi\en  primary  responsibility  for  psychological 
research  on  pilot  training  in  the  Training  Command.  This  Project 
was  on  Randolph  Field  and  was  attached  first  to  the  Central  Instruc¬ 
tors  School  and  later  to  the  Headquarters  of  Central  Flying  Training 

•  Theomcrs  »rr*  M»|.  Neal  E.  M IU.  r  and  Capt.  Donald  E.  Super  from  Piychnloslcal  Research  Unit 
Ko.  I.  An  rarlU-r  btUf  contact  with  training  had  occurred  when  I.t,  Col.  Lawrence  Y.  Shaffer  and  MaJ. 
Krai  E.  Mil!«rr»v»  tccturr.i.n  the  p<ych<  |.*y  of  teiM-hlnc  to  pilots  In  the  Central  Instructors  School  at 
Maswfll  I  HI.  This  contact  wm  Irrinlnitel  when  i’sycholocic/d  Research  Colt  No.  I  wai  moved  from 
Xlaiw'li  firl'l,  Ala.,  toXashtllle,  Trnn, 

•  I  t.  Col.  i’lrhvl  T.  FoUrntcrrrr  was  the  offleer  who  at  first  was  most  responsible  at  Headquarters, 
Tralnlnf  Commonl,  for  foMrrln*  the  devilopnient  of  psycbolorlcal  research  on  problems  related  to  pilot 
tralnlnf.  Afurhrlrft  lor  the  Continental  Air  Forces,  this  role  was  ably  assumed  by  MaJ.  S.  Rains  Wallace 

1  *  Hk-hard  C.  Youti.  John  T.  Halley  and  Olen  Finch  were  chiefly  responsible  for  tnltlatlnt  this 
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Command.4  Similar  organizations  were  also  established  at  the  Navi¬ 
gator  and  the  Bombardier  Central  Instructors  Schools  and  were  given 
the  responsibility  for  psychological  research  related  to  training  in 
those  specialties.  Meanwhile  the  threo  much  larger,  original  psy¬ 
chological  research  units  continued  to  conduct  studies  related  to 
training  as  a  sideline  to  their  main  mission  of  developing  aptitude  tests. 

AREAS  OF  RESEARCH 

The  general  policy  of  tho  psychology  program  was  that  aviation 
psychologists  who  wero  working  in  an  area  such  as  pilot  training, 
should  conduct  fundamental  research  on  problems  of  practical  im¬ 
portance  rather  than  perform  service  functions.  Tho  specific  prob¬ 
lems  on  which  the  Psychological  Research  Project  (Pilot)  worked  wero 
determined  by  directives  from  higher  headquarters.  Tho  two  main 
problems  specified  were  to  develop  techniques  for  selecting  and  evalu¬ 
ating  flying  instructors  and  to  develop  objective  measures  of  flying 
skill.  The  Project  was  also  assigned  responsibility  for  developing 
printed  tests  of  flying  information,  and  for  making  a  job  analysis  of 
the  student  pilot’s  task.  It  was  able  to  find  a  little  timo  in  which  to 
perform  training  experiments. 

Instructor  Selection 

When  tho  Pilot  Project  was  first  established,  Headqunrtcrs,  AAF 
Training  Command,  directed  it  to  work  on  problems  of  instructor 
selection  and  to  confine  its  research  completely  to  such  problems. 
Work  on  instructor  selection  consisted  of  analyzing  the  job  of  teaching 
flying,  constructing  a  battery  of  tests  and  information  blanks  to  get  at 
factors  believed  to  be  related  to  success  ns  an  instructor,  and  examining 
possible  criteria  for  measuring  the  success  of  instructors.  Sinco  no 
rcady-mado  criteria  were  found,  it  wasneccssary  to  develop  rating  scales 
to  measure  teaching  proficiency.  Finally,  these  scales  wero  used  to 
determine  tho  validity  of  a  number  of  instructor-selection  tests  and 
to  make  an  extensivo  study  of  factors  related  to  success  as  a  flying 
instructor.  This  work  is  described  in  chapter  14. 

Objective  Measures  of  Flying  Skill 

In  May  1944,  beforo  the  work  on  instructor  selection  was  completed, 
tho  Pilot  Project  was  directed  to  conccntrato  on  investigating  tho 
feasibility  of  constructing  an  objective  scale  of  flying  skill.  In  this 
work,  Colonel  Flanagan,  Chief  of  tho  Psychological  Branch,  AI1  TAS, 
believed  that  a  large  stock  of  measures  should  bo  accumulated  beforo 
work  was  devoted  to  other  aspects  of  the  problem,  such  as  combining 
the  measures  into  a  total  score,  analyzing  sources  of  variance,  comput¬ 
ing  intercorrelations,  or  comparing  tho  relative  merits  of  check  rides 

•  A  rotter  of  personnel  who  bevt  worked  In  the  Pilot  Project  U  f  l»e o  precedlnj  the  T»M#  of  Content*  of 
this  report. 
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composed  of  objective,  subjective,  or  a  combination  of  these  two  types 
of  measures.  He  therefore  instructed  the  Pilot  Project  to  devote  its 
time  to  the  construction  of  a  large  number  of  objective  measures  and  to 
the  preliminary  evaluation  of  the  suitability  of  each  of  these  measures. 

Because  of  the  magnitude  of  the  task  of  constructing  and  evaluating 
items  to  measure  the  entire  range  of  flying  skill  at  all  levels  of  training, 
the  Pilot  Project  concentrated,  in  tho  first  development  of  objective 
measures,  on  two  crucial  areas:  tho  early  part  of  Primary  training,  and 
instrument  flying.  The  early  part  of  Primary  training  was  selected 
bccauso  that  was  the  time  when  most  eliminations  occurred.  There¬ 
fore,  any  improvement  in  the  measures  used  as  a  basis  for  elimination 
at  tliat  level  would  havo  special  practical  importance  at  that  time. 
It  was  also  somewhat  easier  to  work  at  this  level  because  the  range  of 
talent  had  not  yet  been  so  greatly  restiictcd  by  elimination  of  the 
poor  flyers.  Instrument  flying  was  selected  bccauso  of  its  extreme 
importance  in  combat  and  transport  and  bccauso  tho  fact  that  it  is 
conducted  solely  with  reference  to  instruments  made  it  more  adapta¬ 
ble  to  objective  measurement. 

In  uddition  to  these  two  main  areas,  somo  work  was  done  on  fixed 
gunnery.  This  area  was  selected  because  tho  number  of  hits  on  a 
target  appeared  to  be  a  readily  available,  objective  measure  of  an 
important  aspect  of  tho  fighter  pilot’s  task. 

In  general,  tho  iL;  unction  to  concentrate  tho  first  work  on  item 
construction  and  evaluation  was  adhered  to  closely  with  tho  excep¬ 
tion  of  one  largc-scalo  objective  study  of  tho  effects  of  additional 
training  on  flying  skill.  This  study  was  conducted  at  tho  personal 
request  of  the  Chief  of  Staff  of  tho  Training  Command. 

It  was  possible  to  design  somo  of  tho  item-ovaluation  studies  so 
that,  as  a  byproduct,  they  yielded  information  on  sources  of  varia¬ 
bility  and  on  total  scores.  Theso  results  aro  given  more  space  in  the 
main  bod)  of  this  report  than  would  bo  proportional  to  the  amount  of 
research  time  involved  bccauso  they  appear  to  havo  a  wider  range  of 
applicability  than  information  on  tho  reliability  and  validity  of  each 
one  of  a  Ion '  list  of  items. 

Before  tho  stago  of  item  construction  and  preliminary  evaluation 
was  quite  completed,  so  that  tho  Project  could  movo  on  to  the  noxt 
problems  involved  in  this  work,  the  end  of  tho  war  disrupted  training 
to  such  an  extent  that  further  research  had  to  bo  temporarily  sus¬ 
pended. 

1  ho  research  on  objective  measures  of  flying  skill  is  described  in 
chapters  G  through  11.  Somo  of  the  theoretical  problems  involved  are 
discussed  in  chanter  4. 

Primed  Tests  of  Flying  Information 

„\s  a  supplement  to  its  work  on  developing  objective  measures  of 
fl) .  >g  skill,  tho  Pilot  Project  initiated  tho  development  of  printed 
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tests  of  Hying  information  and  was  subsequently  assigned  chief 
responsibility  for  such  tests  in  the  pilot  area.  Tliero  was  a  need  for 
these  tests  because,  in  addition  to  flying  skill,  the  good  combat  pilot 
had  to  have  a  largo  fund  of  specialized  knowledge.  In  order  to  bo  ablo 
to  get  maximum  performance  and  cope  with  emergencies,  ho  needed 
a  thorough,  practical  understanding  of  the  aerodynamics  and  flying 
characteristics  of  his  airplane,  and  the  design,  functions  and  limitations 
of  its  equipment.  Ho  also  needed  to  know  crucial  facts  about  weather 
and  navigation.  Some  of  theso  types  of  information  could  bo  measured 
moro  efficiently  on  the  ground  than  in  tho  air.  The  development  of 
printed  tests  to  measure  theso  types  of  information  is  described  in 
chapter  12. 

Subjective  Measures  of  Flying  Proficiency 

As  has  already  been  indicated,  the  three  original  psychological 
research  units  investigated  various  subjective  measures  of  flying  pro¬ 
ficiency  as  possiblo  criteria  to  be  used  in  validating  aptitudo  tests. 
Theso  studies  are  described  in  chapter  5. 

Job  Analysis 

As  a  basis  for  developing  aptitudo  tests  and  objective  measures  of 
flying  skill,  various  organizations  in  tho  aviation  psychological  program 
analyzed  different  aspects  of  tho  task  of  learning  to  fly.  Chief 
responsibility  for  this  work  was  eventually  assigned  to  tho  Pilot 
Project.  This  work  is  summarized  in  chapter  3. 

Training  Experiments 

Ono  of  tho  moro  useful  functions  of  aviation  psychologists  should  bo 
in  serving  as  consultants  on  the  design  of  training  experiments.  Tho 
pressuro  of  work  directed  by  higher  headquarters  on  projects  moro 
closely  related  to  tho  aptitude  testing  program,  however,  was  so  great 
during  tho  war  that  almost  no  opportunity  was  left  for  aviation  psy¬ 
chologists  to  work  on  pilot  training  experiments.  Two  minor  studies, 
which  were  conducted  under  conditions  preventing  tho  best  experi¬ 
mental  design,  aro  described  in  chapter  13  in  order  to  illustrate  tho 
typo  of  questions  which  should  bo  answered  by  tho  experimental 
method. 

CONDITIONS  OF  RESEARCH 

Applied  Science 

Tho  research  of  aviation  psychologists  on  pilot  training  during  tho 
war  was  applied,  not  puro,  science.  Tho  direction  of  work  was  guided 
by  rigid  practical  needs  instead  of  moro  flexiblo  scientific  curiosity. 
Tho  need  to  achicvo  specific  goals  within  a  reasonably  short  timo  ex¬ 
cluded  tho  possibility  of  exploring  interesting  incidental  leads  (liko 
the  ono  which  led  Fleming  to  the  discovery  of  penicillin)  to  obtain 
knowlcdgo  which  in  tho  long  run  might  bo  moro  important  than  tho 
original  problem. 


5 


Mace  of  Pilot  Project  in  the  Structure  of  the  Array 

The  Pilot  Project  was  a  pftrt  of  a  program  which  had  representatives 
in  higher  headquarters.  Direct  channels  on  technical  matters  be¬ 
tween  the  Project  and  these  representatives  were  most  useful  in  afford¬ 
ing  nn  overall  perspective  on  those  problems  which  were  likely  to 
become  most  significant,  in  giving  the  strong  administrative  support 
necessary  for  conducting  research,  and  in  obtaining  authority  to  trans¬ 
late  research  findings  into  administrative  action. 

Of  necessity,  the  great  mass  of  army  procedures  was  established 
to  continue  to  deal  with  large  numbers  in  the  same  standardized  way 
for  as  long  as  possible.  Research,  by  its  very  nature,  involves  dealing 
with  relatively  small  numbers  in  different  ways  and  continually  mov¬ 
ing  on  to  new  problems.  Any  research  organization,  therefore,  was 
fated  to  confront  the  typical  army  station  with  a  nr  ucli  greater  numbor 
of  exceptions  to  routine  procedure  than  was  proportionate  to  its  size. 
The  fact  that  these  problems  involved  small  numbers  did  not  reduce 
their  nuisance  value,  but  only  increased  the  possibility  of  the  matter 
getting  sidetracked  by  more  pressing  issues.  It  was  nccessaiy,  there¬ 
fore,  for  army  research  to  be  a  part  of  a  strong  program  having  special 
access  to  High  Headquarters  with  the  authority  to  mako  exceptions 
in  dealing  with  unusual  problems. 

Fitting  a  new  typo  of  research  into  the  army  system  was  bound  to 
produce  certain  paradoxes.  On  the  ono  hand,  tremendous  resources 
were  placed  at  tho  disposal  of  the  aviation  psychologist.  Thousands 
of  cases  wore  available.  He  could  fly  hundreds  of  miles  in  a  few  hours. 
On  tho  other  hand,  unexpected  difficulties  were  sometimes  en¬ 
countered. 

In  order  to  get  tho  Pilot,  Bombardier  and  Navigator  Projects  estab¬ 
lished  quickly,  it  was  necessary  to  set  them  up  without  any  Manning 
Tables,  asking  tho  local  Fields  to  absorb  tho  additional,  highly  trained 
personnel  by  dipping  down  into  tho  limited  allotment  of  vacancies 
which  they  had  available  as  a  reserve  for  promotions.  The  admin¬ 
istrative  setup  was  ono  in  which  highor  headquarters  exercised  direct 
control  over  tho  work  but  tho  local  Base  Unit  was  responsible  for  the 
promotions,  and  had  to  accept  an  increased  burden  without  any 
increase  in  tho  means  at  its  disposal.  As  a  result,  somo  men  with  the 
Ph.  I).  degreo  performed  psychological  research  for  considerable 
periods  of  time  in  tho  grado  of  private.4  Though  many  of  these  men 
wero  able  to  overcomo  tho  handicap  of  low  grade  and  assumo  officer 
responsibilities,  the  lack  of  a  grado  commensurate  with  their  training 
tended  to  make  it  moro  difficult  for  them  to  bo  maximally  effective  in 
Certain  army  situations.  Uespito  tho  shortage  of  scientifically  trained 
enlisted  personnel,  an  average  of  from  10  to  20  hours  per  week  of  each 
man's  time  had  to  be  lost  in  activities,  such  as  KP,  close-order  drill  and 

•  fortunately,  th«  need  for  oflleen  to  sere#  u  clinic*)  psjrrboloclst*  Uter  enabl'd  toms  of  these  men  te 
obtain  tbs  direct  curamluUxu  they  deserted. 
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parades,  which  were  unrelated  to  his  specialty  but  took  automatic 
precedence  over  research.  Finally,  the  considerable  rate  of  turnover 
of  men  who  had  acquired  special  experience  interfered  with  tko 
continuity  of  research  studies. 

Although,  in  general,  excellent  results  were  achieved  by  tho  adminis¬ 
trative  arrangements  which  had  to  be  improvised  during  tho  emer¬ 
gency,  it  is  believed  that  considerable  thought  needs  to  bo  devoted  to 
the  problem  of  making  a  still  better  place  in  tho  structure  of  the  army 
for  an  increasing  number  of  new  types  of  research  personnel. 

Need  for  Psychologists  to  Learn  About  Flying  and  For  Pilots  to  Leam 

About  Psychology 

In  order  to  bo  able  to  apply  psychological  principles  and  methods 
to  the  problems  of  flying  training,  tho  Aviation  Psychologists  needed 
to  acquire  a  thorough  understanding  of  the  particular  conditions  and 
techniques  of  this  complex  specialty.  Since  none  of  them  was  a  pilot 
and  since  they  were  not  authorized  to  receive  formal  flying  training, 
tho  required  intimate  knowledge  of  the  details  of  flying  nnd  of  tho 
vast  and  varied  pilot  training  program  had  to  bo  acquired  gradually 
in  devious  ways,  partly  by  receiving  informal  flying  instruction, 
which  was  inefficiently  unsystematic,  and  partly  by  working  in  close 
collaboration  with  specialists  on  pilot  trnining.  Fortunately,  ox- 
trcmcly  competent  and  cooperative  experts  wero  available.  Tho 
organizations  supplying  most  of  these  experts  are  listed  after  tho 
preface  of  this  volume. 

While  tho  psychologists  were  learning  about  flying,  Air  Forces 
pilots  were  changing  their  ideas  about  psychology.  At  first,  there 
was  a  tendency  to  think  of  tho  psychologist  in  terms  of  tho  popular 
stereotype  of  a  mind  reader,  or  one  who  dolves  into  tho  vaguo  under¬ 
world  of  mental  abnormality.  Some  pilots  had  the  uneasy  feeling 
that  they  might  bo  personally  psychoanalyzed.  They  wero  surprised 
to  learn  that  psychologists  are  interested  in  problems  such  ns  learning, 
tests  and  measurement,  motor  skill,  fntiguo,  nnd  hearing  nnd  vision, 
as  well  ns  fear  and  courngo  nnd  normal  nnd  abnormal  adjustment. 
Thero  was  a  gradual  chango  until  psychologists  were  finally  accepted 
by  tho  Air  Forces  in  tho  less  colorful  but  more  substantial  rolo  of 
scientists  with  special  training  in  applying  useful  techniques  of  ob¬ 
servation  and  measurement,  statistics,  nnd  experiment  to  complex 
problems  of  human  behavior. 
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CHAPTER  TWO. 


Pilot  Training  in  the  Army 
Air  Forces 

Cnpt.  Stanford  C.  Erickson* 


INTRODUCTION 

Tho  purposo  of  this  clmptcr  is  to  outline  tho  organization  of  tho 
Training  Command  and  to  dcscribo  tho  continually  changing  “labora¬ 
tory”  in  which  tho  Pilot  Project  conducted  its  research  program.  A 
bird’s-cyo  view  of  tho  scquenco  of  pilot  training  and  the  organization 
responsible  for  this  task  will  givo  tho  reader  a  perspective  for  better 
understanding  tho  research  reports  described  in  tho  following  chapters. 
This  chapter  is  not  an  historical  summary  nor  is  it  cvaluativo  in  tho 
senso  of  pointing  out  tho  good  or  weak  aspects  of  tho  pilot  training 
program.  Attention  is  focused  on  those  problems  which  havo  particu¬ 
lar  rclcvanco  for  understanding  the  psychological  research  program. 

SEQUENCE  OF  PILOT  TRAINING 

Description  of  Each  Phase  of  Training 

Preflight. — Tho  purposo  of  this  training  was  to  begin  tho  process  of 
providing  tho  cadots  with  tho  necessary  technical  information  and 
military  training  required  by  an  officer  pilot.  Tho  cadots  wero  arbi¬ 
trarily  assigned  to  their  administrative  units  according  to  dato  of  ar¬ 
rival  or  alphabetical  order.  In  fact,  assignment  according  to  alpha¬ 
betical  order  remained  one  of  the  moro  common  bases  of  grouping 
throughout  tho  rest  of  the  cadets’  training.  These  methods  usually 
randomized  tho  distribution  of  pilot  aptitude,  as  reflected  in  tho  pilot 
stanino  based  on  tho  battery  of  classification  tests  administered  by 
aviation  psychologists,  but  sometimes  spccinl  selective  factors  re¬ 
sulted  in  fur  greater  fluctuations  than  would  bo  expected  by  clmnco 
in  tho  ability  of  students  in  different  squadrons  and  schools,  or  in  suc¬ 
cessive  classes  in  tho  entire  command.  Later  in  tho  war  somo  effort 
was  mado  to  cqualizo  tho  stn7,:nes  of  students  sent  from  Preflight  to 
tho  different  Primary  schools. 

Primary. — This  phase  (sometimes  referred  to  as  Elementary  train¬ 
ing)  was  the  first  stago  of  military  flying  training.7  Tho  Primary 

•  MaJ.  I.  K.  l.arVey,  Ch.ilrinnn.  Two-engine  Advl'ory  Training  Hoard,  Central  Imlructun  School  (Pilot), 
Itandolph  Field.  1>i,  ami  Sgt.  Maurice  F.  Connery  avdjtrd  hi  'he  r«T«ratl*.n  of  niaterW  fur  thli  thapteff. 

*  During  the  last  half  of  1915  and  early  1911  alrerew  candidates  Revived  up  to  10  lioura  of  dual  fllgnt  trail* 
tug  In  light  (0J-7J  h.  p.)  tra'.neri  while  in  the  College  Training  Detachment*.  They  did  not  *olo. 
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training  schools  throughout  the  country  were  civilian  operated  schools 
whose  facilities  wore  leased  by  the  Air  Forces.  However,  tho  training 
curriculum,  elimination  policy,  and  the  grading  standards  were  formu¬ 
lated  and  supervised  by  the-  Training  Command.  A  small  military 
unit  was  established  at  each  Primary  school  charged  with  tho  re¬ 
sponsibility  of  supervising  the  military  activities  of  tho  students.  It 
was  in  this  phase  that  tho  greatest  elimination  rato  occurred,  ranging 
os  high  as  50  percent  for  somo  classes  at  some  schools.  During  their 
Primary  training  students  usually  received  a  total  of  65  hours  instruc¬ 
tion,  approximately  35  of  which  were  dual  and  30  solo. 

Hasic.— At  the  end  of  Primary  training  those  students  who  success¬ 
fully  satisfied  tho  requirements  and  appeared  to  have  tho  necessary 
aptitude  for  flying  were  assigned  to  Basic  schools.  With  but  very 
few  exceptions,  the  Basic  schools  wero  operated  entirely  by  Air  Forces 
personnel.  Tho  fundamental  flight  maneuvers  wero  repeated  in  a 
more  powerful  and  complicated  airplano  with  new  emphasis  placed 
on  maximum  performance  and  precision  execution.  The  cadets  wore 
given  introductory  training  in  night  and  formation  flying  and  wore 
taught  the  fundamental  aspects  of  instrument  flying. 

Advinetd. — At  this  level  there  were  two  types  of  specialized  schools: 
Advanced  singlc-cngino  and  Advanced  two-engine. 

Advanced  single-engine  training  followed  tho  pattern  of  basic  but 
in  a  faster  plane  with  greater  emphasis  on  formation  flying,  acrobatics, 
navigation,  and  the  use  of  radio  aids  in  instrument  flying.  Another 
new  feature  of  tho  curriculum  was  tho  introduction  to  simulated 
fixed  gunnery  flying.  The  cadets  flew  camera  missions  and  practiced 
this  type  of  air-to-oir  and  air-to-ground  firing. 

The  Advanced  two-engine  curriculum  was  designed  to  train  multi- 
engine  pilots.  The  cadet  was  taught  the  peculiarities  of  multicngine 
flight  with  a  good  deni  of  emphasis  on  formation  flying,  night  flying, 
navigation,  and  instrument  flying.  At  the  time  of  tho  peak  load, 
approximately  two-thirds  of  all  Advanced  school  students  were  in  tho 
two-engine  schools. 

At  the  conclusion  of  the  Advanced  training  phase  the  cadet  became 
an  officer  in  the  Air  Corps  and  was  given  tho  rating  of  pilot. 

Instructors’  School. — During  the  greater  part  of  tho  war  a  considerable 
number  of  the  recent  graduates  wero  retained  in  the  Training  Com¬ 
mand  as  instructors  for  tho  Basic  and  Advanced  schools  sinco  tho 
cxpnnsion  nml  rapid  turn-over  resulted  in  a  chronic  shortage  of 
instructors.  Immediately  upon  graduation  theso  pilots  wero  assigned 
to  an  instructor  training  squadron.  For  tho  most  part  theso  schools 
were  conducted  locally  qikI  the  prospective  instructor  was  given  a 
week  or  two  of  standardized  flight  instruction  by  specially  selected 
experienced  instructors  at  the  homo  station.  Emphasis  was  placed 
on  tho  uniform  performance  of  the  fundamental  training  maneuvers 
rather  than  on  teaching  techniques  per  so.  A  smaller  proportion  of 
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the  potential  instructors  were  sent  to  central  instructors  schools  which 
served  the  entire  Command. 

Transition. — The  first  intermediate  step  for  rated  pilots  on  their 
way  to  combat  operation  was  a  period  of  Transition  training  in  combat 
type  aircraft.  The  Transition  schools  were  specialized  in  three  groups: 
Fighters,  Two-Engine,  and  Four-Engine  (either  B-17  or  B-24).  At 
this  level  emphasis  was  placed  on  familiarizing  the  pilot  with  the  now 
tactical  type  plane  with  some  practice  in  the  fundamental  maneuvers 
important  in  combat  operations.  For  example,  in  the  Fighter  Transi¬ 
tion  schools  about  half  the  time  was  spent  in  learning  and  practicing 
fixed  gunnery  firing. 

By  the  end  of  Transition  training  the  pilots  had  received  a  total  of 
approximately  40  weeks  of  intensive  flying  training  designed  to  teach 
the  individual  student  the  skills  and  information  necessary  to  mako 
him  a  safe  and  competent  pilot.  At  this  point  the  pilot  left  the  Train¬ 
ing  Command. 

The  Continental  Air  Forces. — The  student-pilots  were  now  ready  for 
the  further  specialized  training  necessary  in  combat  operations: 
skill  in  flying  heavily  loaded  combat-type  aircraft,  use  of  special  equip¬ 
ment,  and  proficiency  in  the  fundamental  maneuvers  used  in  tho 
overseas  theaters.  For  the  bomber  pilot  it  was  particularly  important 
to  add  familiarization  and  integration  with  tho  other  members  of  tho 
combat  crew.  The  four  Continental  Air  Forces  had  the  responsibility 
of  conducting  this  phase  of  training  prior  to  the  assignment  of  the  pilot 
and  crew  to  the  combat  Air  Forces.  A  more  detailed  description  of  tho 
activities  of  the  Continental  Air  Forces  is  given  in  tho  comprehensive 
report  by  the  Aviation  Psychologists  assigned  to  these  units.1 

Combat  Training  Units. — After  the  pilot  arrived  at  his  overseas 
combat  unit,  continued  specialized  training  was  given  in  tho  pro¬ 
cedures  adapted  to  the  particular  conditions  in  that  theater  of  opera¬ 
tions. 

A  summary  of  the  sequence  of  pilot  training  is  presented  graphically 
in  figure  2.1. 

ORGANIZATION  OF  THE  TRAINING  COMMAND 
Headquarters  and  its  Relation  to  Other  Commands  in  the  AAF 

The  AAF  Flying  Training  Command  was  activated  in  Washington, 
D.  C.,  in  January  1942  and  moved  to  Fort  Worth,  Tex.  in  July  of  tho 
same  year.  This  command  was  an  autonomous  Air  Forces  unit  re¬ 
sponsible  only  to  Hcndqunrters  AAF  in  Washington,  D.  C.  In  July 
1943  the  Technical  Training  Command  was  combined  with  the  Flying 
Training  Command  to  form  tho  AAF  Training  Command.  The 
Training  Command  maintained  liaison  with  the  other  major  AAF 

•  Comprehensive  Iteport  No.  IS.  PsycbclotloU  Research  on  Operational  Training  In  tb«  Continental 
Air  Force*. 
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commands.  With  the  return  of  pilots  from  combat  tours,  tho  Per¬ 
sonnel  Distribution  Command  became  a  source  of  supply  for  Training 
Command  instructors  and  administrative  ofliccrs. 

Three  Flying  Training  Commands 

Before  Training  Command  headquarters  was  established  at  Fort 
W.orth,  Tex.,  three  regional  flying  training  commands  had  been  in 
operation,  each  being  responsible  directly  to  Headquarters  AAF  in 
Washington.  The  regional  headquarters  functioned  throughout  tho 
war  as  administrative  units  supervising  tho  training  policies  and 
procedures  originating  in  Washington  and  later  in  iho  Fort  Worth 
Headquarters  for  all  of  the  training  stations  within  their  regional 
jurisdiction.  This  division  of  responsibility  among  tho  three  regional 
flying  training  commands  was  necessary  since  no  one  headquarters 
could  supervise  adequately  their  operation  and  deal  with  the  special 
problems  of  procurement  and  distribution  of  personnel  and  nmtdricl 
for  the  large  number  of  training  stations  devoted  to  pilot  instruction. 
The  three  regional  commands  were:  (a)  Eastern  Flying  Training 
Command,  headquarters  at  Maxwell  Field,  Ala.;  (6)  Central  Flying 
Training  Command,  headquarters  at  Randolph  Field,  Tex.;  and  (c) 
Western  Flying  Training  Command,  headquarters  at  Santa  Ana 
Army  Air  Base,  Calif.  While  these  names  were  changed  from  tiino  to 
time,  the  above  designations  will  be  used  throughout  this  report.  Tho 
training  program  within  tho  three  flying  training  commands  was 
essentially  the  same  though  there  were  always  soino  differences  which 
persisted  in  spite  of  efforts  to  standardize  the  pilot-training  routino. 

Figure  2.2  presents  the  areas  covered  by  ench  of  the  flying  training 
commands  and  the  distribution  of  pilot-training  schools  within  each. 
The  distribution  of  schools  is  only  representative  of  those  in  operation 
early  in  1944  sinco  there  was  a  continuous  process  of  closing  somo 
schools,  activating  new  schools  and  changing  the  functions  of  others. 

Flying  Training  Wings 

As  tho  training  program  expanded  and  bccamo  moro  specialized,  a 
system  of  Wings  was  established  within  each  of  tho  threo  Flying 
Training  Commands.  A  separate  Wing  was  established  for  each  lovcl 
of  pilot  training.  For  example,  ono  Wing  supervised  all  Primary 
training  in  one  command  while  other  Wings  operated  at  tho  Basic, 
Advanced,  or  Transition  level.  Tho  Wings  functioned  as  inspecting 
bodies  charged  with  tho  responsibility  of  standardizing  administrative, 
operational,  and  later,  flying  training  procedures  within  their  assigned 
area. 

Pilot  Training  Schools 

Figures  2.1  and  2.2  indicate  tho  different  types  and  tho  number  of 
pilot  training  schools.  Each  of  theso  schools  was  responsible  directly 
to  its  regional  command  headquarters. 
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Special  Schools 

Instructors  schools  were  established  for  the  major  specialties  of 
pilot  training: 

Central  Instructors  School  (Pilot)  at  Randolph  Field,  Tex. 

Central  Instructors  School  (Instrument  Pilot)  at  Bryan  Army 
Air  Field,  Tex. 

Central  Instructors  School  (Fixed  Gunnery)  at  Matagorda,  Tex. 

Four-engino  Transition  Instructors  Schools  at  Lockboumo 
Army  Air  Base,  Ohio  for  tho  TB-17  and  at  Smyrna  Army 
Air  Field,  Tenn.,  for  tho  TB-24. 

DESCRIPTION  OF  THE  STUDENT  POPULATION 

Successive  Screening  of  Students  in  Pilot  Training 

AAF  Qualifying  Examination. — The  first  screening  of  candidates  for 
pilot  training  was  mado  by  tho  AAF  Qualifying  Examination.  This 
examination  was  taken  by  men  still  in  civilian  status  and  by  enlisted 
men  already  in  tho  army.  It  has  been  estimated  that  thoso  who 
passed  this  examination  represented  tho  top  twenty-fivo  percent  of 
high  school  graduates;  the  over-all  results  showed  that  about  fifty 
percent  of  thoso  who  took  tho  test  failed  to  qualify  as  aviation 
students.* 

The  Pilot  Stanine. — Thoso  who  passed  this  first  hurdlo  wero  sent  to 
a  classification  center  whero  tho  medical  and  psychological  selection 
and  classification  procedures  wero  administered.  Starting  in  Decem¬ 
ber  1942,  men  with  stanine  scores  of  1  and  2,  tho  bottom  11  percent, 
were  disqualified  for  pilot  training.  Gradually  tho  minimum  passing 
stanine  scoro  was  raised  until  at  tho  end  of  the  war  only  men  with  tho 
pilot  stanino  scores  of  7,  8,  and  9,  the  top  23  percent,  wero  admitted 
to  pilot  training. 

Preflight. — Very  few  cadets  wero  eliminated  in  Prcllight  training 
until  later  in  tho  war  when  tho  supply  of  pilot  candidates  exceeded  tho 
quota  requirements.  Tho  most  common  basis  for  Preflight  elimina¬ 
tion,  other  than  medical  or  own  request,  wus  failuro  in  such  courses  as 
mathematics  and  codo.  Usually  a  student  was  given  at  least  two 
chances  to  meet  tho  minimum  qualifications  in  thoso  ground  school 
subjects.  This  is  a  good  cxamplo  of  tho  minimum  weight  given  to 
ground  school  grades  in  tho  evaluation  of  student  pilots.  * 

Elimination  of  students  during  flight  training. — Approximately  50 
percent  of  tho  students  who  entered  flight  training  wero  eliminated 
beforo  completing  Advanced  school  trnining.  Over  half  of  thoso 
eliminations  occurred  at  tho  Prininry  level.  Tho  elimination  rato 
varied  considerably  from  school  to  school  and  from  class  to  class;  a 

•  A  ijiom*  drUilcl  dfMTlptlon  of  th«  nature  of  thli  namlnatlon,  In  ure  mi>I  rwulti  cui  t*  A>unl  to  kkf 
Aviation  Paychology  Program  Rrecarch  Report  No.  H,  TXt  A  A  P  Quafi/jla#  £r«mla«Uo*. 
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rnn^o  of  from  15  to  35  percent  would  bo  ft  fair  cstimftto  of  tho  over-all 
elimination  rate  in  Primary  training. 

Progressively  fewer  students  were  eliminated  in  Basic  ftnd  Advanced 
training.  Student  ofIiccrs  who  failed  to  meet  tho  minimum  profi¬ 
ciency  requirements  at  the  Instructor  ftnd  Transition  schools  were 
usually  transferred  to  some  assignment  which  would  make  fower 
demands  upon  their  pilot  skill. 

A  Homogeneous  Population 

Itt strict f d  range—  Insofar  ns  tho  tests  used  in  the  original  screening 
of  pilot  candidutcs  correlated  with  success  or  failuro  in  training,  a 
restricted  range  of  pilot  nptitudo  was  sent  into  flight  training.  In 
addition,  the  successive  elimination  of  students  in  tho  different  phases 
of  training  resulted  in  ft  fairly  homogeneous  population  of  students 
possessing  a  high  average  level  of  aptitude  in  advanced  levels  of  train¬ 
ing.  As  tho  need  for  pilots  became  less  acute  tho  restriction  became 
greater  both  through  the  selection  of  candidates  and  in  tho  graduation 
of  students  from  the  successive  phases. 

Implications  j or  research. — This  restricted  rango  of  pilot  nptitude 
niado  tho  task  of  discriminating  between  individual  students  with 
objective  or  subjective  measures  of  flying  skill  moro  difficult  than  it 
would  hnvo  been  with  an  unsclcctcd  population.  Since  this  factor 
will  probably  always  exist  in  military  aviation  training,  it  is  quite 
likely  that  higher  proficiency  test  reliabilities  would  bo  obtained  in 
conditions  ordinarily  found  in  civilian  flying  training. 

In  contrast  to  this  difficulty  for  developing  reliable  measures  of 
flying  skill,  tho  homogeneity  of  tho  population  would  have  been  ft 
decided  advantage  in  conducting  experiments  to  compare  tho  effects 
of  different  types  of  training  or  equipment  sinco  it  would  hftvo  reduced 
tho  standard  error  of  tho  difference. 

SCHEDULING  TO  MEET  QUOTA  REQUIREMENTS 
Mass  Production 

Tho  Training  Command  had  to  produce  ft  largo  number  of  pilots  in 
a  short  timo.  Planning  was  dono  in  units  of  thousands  of  pilots.  In 
order  to  meet  tho  largo  requirements  of  tho  entiro  Air  Forces,  the 
Training  Command  set  up  a  mass  production  assembly  line  system  of 
pilot  training.  No  provisions  wero  mado  for  individualized  training 
except  insofar  ns  tho  instructors  could  vary  their  technique  during 
tho  separato  flights  with  each  student.  Everyono  within  a  given 
school  was  given  the  snmo  training  with  the  same  timo  limit  for  reach¬ 
ing  tho  minimum  level  of  proficiency  in  each  sub-unit. 

Rigid  schedule. — Many  technical  schools  in  tho  army  practiced  the 
“hold-over”  system  of  retaining  slow  students  from  class  to  class  to 
bring  them  to  tho  minimum  proficiency  standards  for  graduation. 
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But  only  in  rare  eases,  for  reasons  such  as  sickness  or  emergency 
absence  from  the  school,  did  the  Training  Command  permit  “hold¬ 
overs"  during  flight  training.  It  was  necessary  to  hold  rigidly  to  tho 
time  limit  allotted  for  each  phase  of  training  and  no  provision  was 
made  for  the  slow  learner  except  elimination.  Irrespective  of  weather 
or  individual  aptitude,  each  class  had  to  bo  graduated  on  schedulo  and 
had  also  to  meet  a  minimum  standard  of  proficiency.  This  created  a 
very  difficult  task  for  supervisory  personnel  who  wero  held  responsible 
for  meeting  the  scheduled  deadlines.  One  ornament  almost  universally 
found  in  offices  of  Directors  of  Flying  wa3  a  chart  showing  tho  progress 
of  tho  current  classes  toward  meeting  tho  goal  of  tho  prescribed  number 
of  hours  of  flying  within  the  timo  limits  allowed.  Sinco  “hours  flown” 
was  a  moro  obvious  record  than  level  of  student  proficiency,  it  con¬ 
sequently  received  greater  emphasis  in  arranging  schedules  and  rovising 
tho  curriculum. 

Regular  Rate  cf  Class  Advancement 

During  tho  early  part  of  tho  war  each  phaso  of  training  required  8 
weeks;  this  was  later  extended  to  0  weeks  and  finally,  in  1044,  to  a 
10  weeks  period. 

In  Preflight  tho  students  wero  assigned  a  class  codo  which  thoy 
kept  throughout  tho  rest  of  their  training.  Class  43-B,  for  instance, 
was  tho  second  graduating  class  in  1943.  In  order  to  utilize  tho  train¬ 
ing  facilities  most  efficiently,  two  classes  wero  in  training  at  any  one 
timo  at  cncli  school.  For  tho  first  fivo  weeks  tho  students  were  lowor 
classmen,  then  moved  up  to  upper-class  status  when  tho  new  lowor 
class  entered  tho  school.  Classes  wero  graduated  from  each  phaso  of 
training  every  fivo  weeks. 

Quota  Requirements  v.  the  Individual  Student 

The  quota  system,  which  frequently  reflected  tho  somewhat  un¬ 
predictable  combat  requirements,  often  put  local  supervisory  personnel 
in  a  “straight-jacket”  to  provido  tho  number  of  students  called  for  by 
higher  headquarters.  For  example,  often  times  tho  Basic  schools 
would  not  know  until  nearly  tho  last  week  beforo  graduation  how 
many  of  their  students  wero  to  bo  assigned  to  Advanced  singlc-cngino 
training  and  how  many  to  Advanced  two-engino  schools.  Tho  result 
was  to  minimizo  weight  given  to  the  preference  and  qualifications  of 
the  individual  student. 

PROBLEM  OF  STANDARDIZING  PILOT  TRAINING 
Factors  Producing  Variability 

Rapid  Expansion. — “From  1  October  1931  to  1  January  1939  not  a 
singlo  new  training  station  had  been  established.  On  the  latter  dato, 
tho  United  States  had  but  two  air  school  training  stations:  Kelly  and 
Randolph.  It  was  therefore  on  theso  two  fields  alono  that  tho  great 
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expansion  program  for  pilot  training  was  to  bo  started  .**  These  two 
schools  were  expanded  into  ft  pilot  training  organization  consisting  of 
well  over  100  schools.  Table  2.1  shows  the  incrcaso  in  number  of 
pilots  graduated  each  year  from  1937  through  1944.  During  these 
eight  years  there  was  an  increase  of  moro  than  forty-four  thousand 
percent.  In  addition  to  handling  this  expanded  load,  it  was  necessary 
to  assign  many  of  the  original,  experienced  pilots  to  tactical  groups 
on  tho  fighting  fronts. 


Table  2.1. — Number  of  pilot  graduate*  from  1937  through  1944 
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In  tho  early  days  of  tho  expansion,  tho  Commanding  Officer  of  a 
now  school  was  given  an  unprecedented  load  of  students  and  told  to 
go  ahead  to  turn  out  the  best  pilots  ho  could  by  whatever  means  and 
resources  ho  could  obtain.  After  each  Commanding  Officer  was  suc¬ 
cessful  in  solving  his  own  problems  in  his  own  way,  ho  was  reluctant  to 
chnngo  his  training  procedures  without  good  and  sufficient  reasons. 
Thus,  tho  autonomy  which  was  necessary  during  tho  emergency  ex¬ 
pansion  when  no  trained  personnel  could  bo  spared  for  standardizing 
tho  different  schools,  resulted  in  tho  growth  of  different  local  traditions 
which  had  a  strong  tendency  to  persist. 

Procurement  difficulties  resulted  in  differences  between  schools  and 
tho  three  regional  commands.  For  n  considerable  timo  threo  different 
Primary  trainers  wero  in  uso  throughout  tho  Training  Command  and 
sometimes  two  different  planes  wero  used  at  tho  samo  school.  As 
many  as  six  different  types  of  planes  havo  been  used  at  tho  Basic 
lovel,  and  tho  samo  kind  of  variation  occurcd  in  Advanced  two-engine 
schools.  Even  whero  tho  samo  typo  of  piano  was  used,  differences 
existed  in  such  specific  details  as  typo  of  propeller,  type  of  instrument 
hoods,  and  kind  of  interphono  system.  Though  ono  typo  of  equip¬ 
ment  might  havo  been  recognized  as  being  superior,  procurement 
difficulties  resulted  in  frequent  delays  in  obtaining  a  supply  which 
was  ndequato  for  tho  entiro  Training  Command. 

Geographical  Differences 

It  can  bo  noticed  from  figuro  2.2  that  most  of  tho  Training  Command 
Stations  wero  located  in  tho  southern  and  southwestern  states  with  a 
good  many  moro  in  California.  Nevertheless,  tho  climato  and  typical 
weather  conditions  varied  a  good  deal  among  theso  scattered  stations. 
Tho  Training  Command  required  tho  schools  to  maintain  their  quotas 
and  time  limits  for  training  despito  variable  weather  conditions. 

“  ,,Ukfr  Arrar  A&  rofOM  Central  Flying  Training  Command,  VoL  I,  I  Jin.  1039-7  D«*.  1941,  pp.  1MQ, 
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During  periods  of  poor  flying  weather,  flight  instruction  was  massed 
into  those  few  favorable  days  which  did  occur.  Differences  in  eleva¬ 
tion,  and  hence  in  the  lifting  power  of  the  air,  from  school  to  school 
introduced  an  additional  variable  into  the  performance  of  tho  airplano. 

Temporal  Changes  in  the  Training  Routine 

The  necessity  of  meeting  tho  fluctuating  demands  of  tho  combat 
units  fighting  on  many  diverse  and  rapidly  changing  fronts,  required 
a  continuously  changing  training  program  to  provide  tho  best  qualified 
combat  pilots.  Tho  prossuro  resulting  from  this  typo  of  variability 
was  moro  apparent  at  the  Advanced  levels  than  in  tho  Primary  and 
Basic  schools.  An  even  more  important  factor  producing  changes  was 
tho  great  increase  in  tho  knowledge  of  how  to  fly  and  teach  flying. 

Examples  of  Variability 

A  good  example  of  variability  between  schools  appeared  whon  the 
Pilot  Project  was  conducting  a  Inrgc-scnio  study  at  all  schools  in  tho 
Training  Command  to  determine  tho  effect  of  an  extra  fivo  weeks  of 
training  (sco  chapter  10).  'When  tho  training  supervisors  from  each 
of  tho  two -engine  schools  wero  called  together  for  a  briefing  conference, 
a  good  deal  of  discussion  occurred  as  to  tho  specific  details  of  manner 
of  performing  tho  check-ride  maneuvers.  Most  of  theso  men  seemed 
to  bo  surprised  at  tho  extent  of  tho  differences  between  stations  on 
somo  of  tho  traditional  and  fundamental  maneuvers.  While  theso 
differences  probably  bad  no  effect  on  tho  over-all  effectiveness  of  tho 
Advanced  school  students,  they  mado  it  difficult  to  establish  uniform 
testing  conditions  at  all  of  tho  two-engino  schools.  For  example, 
somo  schools  used  full-flaps  and  others  half-flaps  during  landings. 
Somo  schools  prohibited  turning  in  tho  direction  of  tho  dead  engine 
during  singlc-cngino  procedure  while  others  mado  such  turns  routinely. 
Somo  schools  used  a  canvas  hood  during  instrument  maneuvers  while 
others  used  colored  glass  shields  and  goggles.  At  somo  stations  a 
good  deal  of  practico  was  given  on  tho  power-off  npproach  and  landing 
maneuver  while  at  others  only  demonstration  rides  were  given. 

Some  schools  gave  instrument  training  in  a  separato  instrument- 
training  squadron  while  others  believed  that  the  most  efficient  method 
was  to  have  the  samo  instructor  givo  both  contact  and  instrument 
instruction.  Tho  distribution  of  instrument  instruction  also  varied 
from  school  to  school;  somo  spread  this  training  through  tho  entire 
10  weeks,  while  others  concentrated  instrument  training  during  the 
first  5  weeks,  or  tho  middle  5  to  8  weeks  of  training. 

Grading  and  standards  for  elimination  have  always  been  a  difficult 
problem  to  standardize.  Ono  Commanding  General  was  rather 
alarmed  at  tho  high  elimination  rato  in  tho  Primary  schools  in  his 
regional  command  and  ordered  all  Primary  schools  with  elimination 
rates  abovo  tho  averago  of  tho  command  to  reply  by  letter  of  indorse¬ 
ment  giving  full  explanation.  In  another  command,  a  dircctivo  was 
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issued  prohibiting  any  advanced  school  from  graduating  students 
"below  average”  in  over-all  pilot  proficiency.  Sinco  tho  quota  de¬ 
mands  for  the  schools  remained  the  same,  the  only  alternative  was 
the  elimination  of  all  "below  average”  grades  and  the  consequent 
lessening  of  the  discrimination  shown  by  the  flying  ability  ratings  of 
the  graduating  students.  In  another  instance,  a  directive  was  issued 
to  the  effect  that  no  student  would  be  given  any  idea  of  his  progress 
during  training.  It  was,  of  course,  practically  impossible  to  comply 
with  this  directive  which  was  later  rescinded. 

Unifying  Agencies 

Increased  Control  by  Headquarters— The  critical  shortago  of  ex¬ 
perienced  training  personnel  needed  for  assignment  to  headquarters 
units  required  that  nearly  all  of  their  time  be  spent  with  such  problems 
os:  procurement,  creation  of  new  schools,  and  preparation  of  adminis¬ 
trative  directives.  As  more  qualified  officers,  particularly  pilots 
familiar  with  the  new  training  problems,  became  available  for  head¬ 
quarters  assignments,  the  Training  Command  increased  its  central, 
unifying  control  over  the  entiro  program. 

Flying  Training  Wings. — 1 The  Flying  Training  Wings  in  each  of  the 
regional  Hying  Training  Commands  helped  to  standardize  training 
bv  inspecting  tho  administrative  and  operational  procedures  in  all 
school*  at  a  given  lovcl  of  training. 

Instructors  Schools. — At  nearly  all  stations  local  instructors  schools 
wero  established  to  help  standardize  tho  flying  performance  of  the 
transfers  and  the  new  graduates  being  retained  ns  instructors.  During 
early  1912  instructors  schools  wero  established  to  servo  each  of  tho 
throo  flying  training  commands  as  an  expansion  of  the  program  fol¬ 
lowed  by  the  local  stations.  Tho  first  classes  sent  tc  these  schools 
wero  carefully  selected  and  included  a  large  portion  of  supervisory 
personnel  from  nil  stations  within  the  commands.  Not  only  did  this 
procedure  provide  for  a  rapid  dissemination  of  tho  instructor  school 
methods  to  men  in  key  positions  but  it  also  added  prestigo  valuo  to 
pilots  selected  for  training  in  subsequent  classes. 

In  March  1913  the  regional  command  schools  were  consolidated  to 
form  the  Central  Instructors  School  (Pilot)  at  Randolph  Field,  Tex. 
However,  many  of  the  local  schools  continued  until  the  end  of  tho  war. 
The  Central  Instructor  School  (Pilot)  drew  personnel  from  all  three 
commands  and  was  staffed  by  an  exceptionally  ablo  and  experienced 
group  of  instructors.  This  new  school  continued  to  emphasizo  pre¬ 
cision  standardized  contact  flying  rather  than  pedagogical  technique. 

CIS  never  had  the  authority  to  conduct  inspecting  tours  through  the 
Training  Command  to  determine  tho  extent  of  uniformity  of  teaching. 
Its  influence  was  accomplished  through  its  advisory  function,  prepara¬ 
tion  of  manuals,  and  by  its  graduates  who  were  sent  to  all  schools  in 
tho  Command. 
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The  Central  Instructors  School  (Instrument  Pilot)  was  established 
at  Bryan,  Tex.,  for  the  purpose  of  training  and  standardizing  instru¬ 
ment  instructors.  Only  rated  pilots  were  sent  to  this  school,  and 
after  completing  this  course  they  returned  to  their  homo  stations  os 
instrument  instructors  or  members  of  the  instrument  standardization 
board.  It  was  the  goal  of  the  Training  Command  to  havo  every 
person  functioning  in  cither  of  these  capacities  a  Bryan  graduate.  In 
general,  the  Bryan  instrument  school  performed  the  same  function  for 
instrument  flying  as  the  Central  Instructors  School  at  Randolph  Field 
did  for  contact  flying.  The  manunls  for  instrument  training  wero  pre¬ 
pared  by  Bryan  personnel  who  were  also  responsible  for  the  prepara¬ 
tion  of  the  various  checks  given  at  different  times  during  instrument 
training. 

Standardization  Boards 

Early  in  1942  the  Commanding  Officers  at  most  schools  designated 
a  small  group,  usually  four  or  five,  of  the  more  experienced  and  expert 
instructors  to  be  members  of  the  Station  Standardization  Bonrd.  In 
the  beginning  these  boards  were  identical  with  tho  local  instructors 
schools.  Gradually  their  function  became  more  specialized  and  their 
primary  responsibility  became  the  making  of  periodic  flight  checks 
with  both  students  and  instructors  to  help  mnintnin  uniform  methods 
of  performing  the  fundamental  training  maneuvers. 

Later  Wing  standardization  boards  were  established  to  help  reduce 
the  differences  between  schools  at  tho  same  level  of  training.  Stand¬ 
ardization  hoards  (called  Advisory  Training  Boards)  were  also  estab¬ 
lished  in  the  Central  Instiuotors  Schools  and  were  perhaps  tho  greatest 
single  source  of  expert  pilot  advisors  foi  the  Pilot  Project.  They  wero 
particularly  help!  i  in  designing  objective  measures  which  could  most 
readily  be  adapted  to  conditions  in  tho  various  cooperating  schools. 

Training  Manuals 

The  original  technical  manuals  published  by  tho  Air  Corps  wero 
poorly  adapted  for  use  in  the  expanded  modern  training  program. 
The  Central  Instructors  Schools  were  given  the  job  of  revising  tho 
prewar  manuals  in  collaboration  with  such  special  groups  ns  tho  Oflico 
of  Flying  Safety,  the  Visual  Training  Aids  Department,  and  tho  Film 
Strip  Unit.  These  new  manuals  were  generally  accepted  ns  being  an 
outstanding  contribution  to  tho  training  program  and  were  used 
throughout  the  Training  Command.  The  descriptions  and  explana¬ 
tions  of  tho  fundamental  training  maneuvers  functioned  ns  one  of  tho 
strongest  standardizing  factors  in  tho  Training  Command.  Tho 
Ground  Training  Technical  Advisory  Department  at  Randolph  Field 
played  a  similar  rolo  in  tho  preparation  and  supervision  of  tho  ground 
school  curriculum. 
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Gradual  Diffusion  of  Experienced  Training  Command  Personnel 

In  addition  to  the  formal  agencies  operating  to  standardize  the  pilot 
training  program,  an  additional  factor  played  an  increasingly  import¬ 
ant  role  as  time  progressed.  The  continuous  process  of  transferring 
instructor  and  supervisory  personnel  from  one  station  to  another  and 
to  headquarters  units  tended  to  produce  a  synthesis  of  divergent  opin¬ 
ions  and  methods  of  training. 

Degree  of  Uniformity  in  Pilot  Training  at  the  End  of  the  War 

Toward  the  end  of  tho  war  tho  pilot  training  program  had  reached 
its  highest  level  of  uniformity  and  efficiency  of  training.  Wing  mem¬ 
bers  were  familiar  with  the  variable  characteristics  of  each  station,  and 
tho  local  standardization  boards  wero  able  to  make  frequent  flight 
checks  with  each  instructor.  A  progressively  larger  proportion  of  the 
instructors  were  graduates  from  tho  Central  Instructors  Schools  and 
there  had  been  extensivo  diffusion  of  training  personnel  from  station 
to  station.  Procurement  bottlenecks  were  a  diminishing  source  of 
difference  between  stations.  Training  manuals  were  generally 
accepted  and  used  ns  guides  by  most  instructors,  and  finally,  the 
students  themselves  were  a  more  highly  selected  and  homogeneous 
group  possessing  a  high  level  of  flying  aptitude. 

All  of  theso  factors  operating  together  resulted  in  considerable 
progress  toward  improving  tho  efficiency  and  uniformity  of  training 
bnt  differences  still  remained.  Although  it  emphasized  standardiza¬ 
tion,  tho  Training  Command  recognized  that  a  certain  amount  of 
variability  was  necessary  for  tho  growth  of  new  and  better  ideas. 

SUMMARY 

This  chapter  presents  a  brief  summary  of  those  aspects  of  the  organi¬ 
zation  of  the  Training  Command  and  of  tho  successive  phases  of 
training  which  aro  important  as  a  background  for  understanding  the 
research  described  in  the  following  chapters. 

Tho  Training  Command  functioned  directly  under  tho  Hcadquar* 
tors  of  tho  Army  Air  Forces.  It  was  subdivided  into  three  regional 
Flying  Training  Commands,  which  supervised  pilot,  bombardier,  and 
navigator  training.  Within  each  of  the  Flying  Training  Commands  a 
system  of  ings  was  established  to  servo  as  inspecting  and  standardiz¬ 
ing  units  for  nil  pilot  training  schools. 

Bccauso  of  tho  pilot  aptitude  tests  and  the  elimination  of  poor 
students  in  earlier  phases  of  training,  tho  population  of  pilot  student# 
represented  a  restricted  range  of  high  talent.  Tho  mass  production 
assembly  lino  system  of  pilot  training,  and  tho  extreme  pressure  of 
wnr-time  expansion  limited  tho  freedom  of  introducing  modifications 
for  purposes  of  research.  Tho  rapid  growth  of  tho  pilot  training 
program,  its  wide  geographic  distribution,  the  impact  of  new  combat 
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requirements,  the  discovery  of  dcw  training  techniques,  and  tho  pro¬ 
curement  of  different  types  of  equipment  produced  variability  between 
different  schools  at  tho  samo  time  and  changes  in  tho  sanio  school  at 
different  times.  These  variations  had  to  bo  carefully  watched  as 
sources  of  constant  errors  in  research.  Tho  standardization  boards 
and  other  agencies,  which  wero  created  to  disseminato  improved 
techniques  and  to  reduco  variability,  were  valuablo  sources  of  technical 
assistance  in  conducting  research. 
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CHAPTER  THREE 


Analysis  of  the  Pilot’s  Task 

Capt.  Richard  P.  Youtz  and  Capt.  Stanford  C.  Erickscn 


INTRODUCTION 

The  purposo  of  this  chapter  is  to  doscribo  tho  task  of  learning  how 
to  become  a  military  pilot.  Tho  first  surveys  of  tho  task  of  learning 
to  fly  wero  mado  in  order  to  provido  a  basis  for  developing  pilot 
aptitudo  tests.  In  tho  first  survey,  written  board  reports  wero  ex¬ 
amined  and  tho  different  types  of  reasons  for  eliminating  students 
from  training  were  tabulated;  then  experienced  instructors  and  stu¬ 
dents  who  lnul  just  been  eliminated  wero  interviewed.  Much 
later,  somo  aviation  psychologists  wero  ablo  to  sccuro  a  certain 
amount  of  flying  training.  In  connection  with  developing  objcctivo 
measures  of  flying  skill,  tho  members  of  the  Pilot  Project  mado  do- 
tailed  studies  of  relevant  aspects  of  the  pilot’s  task.  For  cxamplo, 
they  performed  informal  experiments  to  determino  tho  effect  of  various 
deviations  from  tho  prescribed  techniquo  of  spin  recovery  upon  tho 
amount  of  altitudo  lost  and  tho  length  of  timo  required  for  recovery. 
It  was  necessary  to  perform  such  studies  in  order  to  determino  which 
aspects  of  various  maneuvers  wero  most  relovant  and  what  tho  rela¬ 
tionship  was  between  tho  techniquo  of  tho  pilot  and  objcctivo  measures 
of  different  aspects  of  tho  performance  of  tho  airplano. 

Flying  is  a  complex  skill.  Our  scientific  lnnguago  docs  not  yet 
contain  tho  words  and  concepts  for  summarizing  briefly  and  accurately 
tho  demands  of  such  a  skill.  Any  attempt  to  dcscribo  this  task,  there¬ 
fore,  confronts  the  dilemma  of  either  describing  on  exceedingly  long 
scries  of  specific  details  or  making  broad  generalizations  which  nro 
quito  inexact.  Until  tho  fundamental  knowledge  of  tho  structuro  of 
tho  human  abilities  involved  in  complex  psychomotor  skills  has  been 
considerably  increased,  psychologists  conducting  research  on  flying 
will  probably  need  to  acquire  by  direct  experience  a  moro  inlimnto 
knowlcdgo  than  can  bo  presented  in  words. 

Although  tho  ultimato  goal  of  all  military  flying  training  was 
operational  flying,  the  descriptions  in  this  chapter  will  bo  confined  to 
tho  typo  of  flying  with  which  tho  authors  nro  familiar,  that  dono  in 
tho  Training  Command.  It  should  bo  noted,  however,  that  becauso 
tho  ultimato  goal  was  combat,  military  flying  training  was  different 
from  civilian.  While  tho  civilian  student  pilot  flew  airplanes  that 
were  designed  for  safety,  economy,  and  ease  of  operation,  tho  military 
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pilot  began  nnd  continued  his  training  on  airplanes  that  wero  much 
moro  powerful,  had  a  higher  wing-loading,  and  wero  designed  to  pre¬ 
pare  the  student  for  the  maximum-performance  planes  used  in  combat. 

Tho  civilian  student  pilot  ordinarily  began  his  training  in  an  air- 
piano  of  CO-75  hp.,  and  ono  that  was  easy  to  land.  Tho  military 
student  pilot  started  his  training  in  an  airplane  of  220  hp.,  and  one  that 
was  designed  to  train  tho  student  in  tho  techniques  of  landing  much 
more  highly  powered  nnd  maneuverable  combat  airplanes.  The  mili¬ 
tary  student  pilot  was  under  pressure  to  learn  rapidly  and  thoroughly 
in  a  relatively  short  period  of  time,  while  the  civilian  student  right 
fly  or  not  as  he  pleased  nnd,  before  soloing  or  going  on  to  any  succced- 
ng  stage  of  performance,  could  take  as  much  dual  flight  instruction  as 
lo  could  afford.  Nevertheless,  tho  fundamental  elements  of  flying 
skill  and  tho  techniques  and  principles  of  take-offs  nnd  landings 

fir  'hnt'h  " ^C":turns'ftn^!traighfc-«nd-lcvel  flight  were  basically  similar 
for  both  civilian  and  military  flying. 

t„I',innflvLpr:r,,'"roln  Tchrcr  wm  b° 10  »•'«* 

"ylns- 10  <lKcnbc  «l‘Cir  salient  points,  nnd  then  to  summarise 
tho  hj  potheses  concerning  tho  necessary  skills.  Tho  chapter  is  divided 
into  two  parts:  I.  The  Fundamental  Elements  of  Flying  Skill  -  and  II 
Areas  of  Military  Flying  Training.  Sincotho  fundamental' 
elements  wero  taught  almost  entirely  at  the  Primary  lovel  tho  first 
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Port  I.  The  Fundamental  Elements  of  Flying  Skill 

Cnpt.  Richard  P.  Yout«“ 
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general  difficulties  in  flying  derived  from 

CHARACTERISTICS  OF  TIIE  AIR 

Compared  with  driving  a  car  along  a  road,  flying  an  airplano  from 
take-off  through  landing  presents  a  number  of  new  problems  which 
grow  out  of  the  characteristics  of  the  air. 

Air  Is  Transparent  and  Without  Reference  Points  , 

Unlike  automobile  driving  in  which  the  driver  can  see  tho  sides  of 
the  road  and  the  lino  in  tho  center  of  the  road  with  relative  eoso,  tho 
pilot  of  tho  airplano  must  perform  most  of  his  maneuvers  using  only 
distant  reference  points,  such  ns  tho  horizon,  or  largo  features  of  tho 
landscape  far  away.  Because  of  tho  remoteness  of  theso  reference 
points  tho  amount  of  relative  movement  is  very  small;  tho  airplano 
seems  to  stand  still  and  hang  in  tho  sky  until  tho  student  has  learned 
to  mako  tho  necessary  finer  perceptions  and  to  evaluate  them  in  terms 
of  tho  actual  speed  of  tho  airplano.  Tho  importance  of  theso  finer 
perceptions  of  far-away  reference  points  is  strongly  demonstrated  to 
the  student,  particularly  in  cross-country  flying  and  in  simulated  forced 
landings  where  tho  student  must  visualizo  his  three-dimensional  flight 
path  through  transparent  space. 

During  take-offs  and  landings  tho  rcfcrcnco  points  aro  nearby  but 
tho  airplano  is  going  so  fast  that  tho  immediate  surroundings  ore 
blurred.  Tho  pilot  must  chooso  reference  points  that  aro  not  so  near 
as  to  bo  blurred  or  so  far  away  ns  to  bo  irrelevant  to  tho  take-off  or 
landing. 

The  Air  Is  a  Fluid,  Elastic  Medium 
Since  tho  air  is  fluid,  it  is  subject  to  currents  and  turbulence.  Tho 
airplano  drifts  with  the  currents  or  winds,  and  this  drift  must  bo  taken 
into  account  in  any  maneuver  related  to  rcfcrcnco  points  on  tho 
ground,  such  as  take-off,  landing,  cross  country,  etc.  Perceiving 
slight  tendencies  to  drift,  and  differentiating  tho  rclatiyo  movements 
in  tho  forward  area  of  vision  which  aro  caused  by  drift  from  thoso 
caused  by  slight  turns,  aro  new  and  difficult  types  of  discrimination 
for  tho  average  student.  Sinco  tho  air  is  turbulent,  tho  airplano  may 
bo  shaken  about  and  thrown  off  courso  and  tho  perception  of  drift  must 
bo  mado  against  a  background  of  unsteady  movement.  Turbulcnco 
may  also  causo  airsickness. 

Sinco  the  air  is  clastic,  tho  controls  of  an  airplano  hnvo  a  less  positive 
effect  than  tho  controls  of  an  automobilo  in  which  tho  deflection  of  tho 
steering  wheel  determines  directly  tho  radius  of  turn.  Under  certain 
conditions,  tlicro  may  bo  a  temporal  log  beforo  tho  pressures  on  tlio 
controls  of  an  airplano  take  effect  or  it  may  “mush”  through  tho  air  in 
much  tho  samo  way  that  a  car  makes  a  skidding  turn  on  a  slippery  roa  , 
An  airplano  is  guided  by  control  pressures  which  in  turn  causo  1 10 
control  surfaces  of  tho  ailerons,  rudder,  and  clovators  to  exert  pres- 
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surca  on  the  stream  of  nir  pnssing  by  them.  This  deflects  the  airplane 
in  one  direction  or  another.  At  high  air  speed  a  slight  movement  of 
the  controls  will  produce  a  considerable  effect;  when  the  air  speed  is 
lower,  as  in  landing,  much  more  extensive  movements  are  required  to 
produce  the  same  result.  Although  the  extent  of  movement  differs 
greatly,  the  amount  of  pressuro  exerted  on  the  controls  in  producing 
these  movements  remains  approximately  tho  same.  The  student, 
therefore,  must  learn  to  control  his  aircraft  in  terms  of  pressures  in¬ 
stead  of  movements.  This  chango  is  disconcerting  to  some  students. 

Flying  Is  Paced 

An  airplane  must  maintain  its  speed  or  fall  to  tho  ground.  In  fog 
or  darkness  tho  airplnno  must  continuo  at  tho  same  paco  and  in  many 
situations  the  pilot  is  forced  to  make  rapid  decisions  because  of  the 
necessity  for  maintaining  speed.  Safety  in  flight  is  usually  obtained 
by  flying  “high  and  fast"  rather  than  “low  and  slow."  This  is  unlike 
automohilo  driving  in  which  tho  vehicle  may  be  slowed  down  or 
stopped  at  any  time  to  give  the  driver  a  clianco  to  consider  what  to  do 
next.  The  pilot  is  always  forced  to  pay  attention  to  speed  and  add 
this  variable  to  the  complex  of  stimuli  that  demand  his  attention. 

Steering  in  Flight  Is  in  Three  Dimensions 

Besides  steering  tho  nirplano  to  tho  right  or  to  tho  left,  as  an  auto¬ 
mobile  driver  has  to,  the  student  pilot  must  point  tho  nose  up  or  down 
in  order  to  maintain  the  desired  altitude  and  must  also  keep  tho  wings 
level  or  properly  banked  at  all  times.  Thus  the  pilot  has  three  kinds 
of  steering  to  do  compared  with  the  automobile  driver’s  one.  Not 
only  does  tho  pilot  have  two  moro  kinds  of  steering  but  tho  difficulties 
of  steering  nro  multiplied  many  times  bccauso  of  tho  interrelationship 
between  tho  different  kinds.  In  making  turns  it  is  necessary  to  bank 
tho  piano  so  that  tho  wings  nro  at  an  angle  with  tho  horizon.  In 
doing  this  tho  sideward  pressuro  on  tho  stick  must  bo  matched  with 
nn  appropriate  pressuro  on  tho  rudder  in  order  to  avoid  skidding  or 
slipping.  Since  hanking  tho  wings  reduces  tho  lift,  it  is  also  necessary 
to  pull  hack  on  tho  stick,  increasing  tho  anglo  of  attack  in  order  to 
maintain  n  constant  altitude. 

CRUCIAL  ASPECTS  OF  PRIMARY  FLYING 

This  section  will  doscribo  thoso  maneuvers  which  best  illustrate 
kry  difficulties  in  learning  to  fly.  It  is  not  tho  purposo  of  this  section 
to  give  a  completo  description  of  all  of  tho  maneuvers  in  Primary 
training;  it  will  bo  limited  to  thoso  portions  of  tho  task  which  appear 
to  bo  most  important  in  differentiating  tho  better  from  tho  poorer 
student.*. 

Sinec  approximately  00  percent  of  the  students  went  to  Primary 
school  without  previous  flying  experience,  they  had  to  bccomo  adjusted 
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to  tho  new  sensations  encountered  in  flight.  Most  of  the  students 
were  well  motivated  by  one  or  more  of  a  number  of  factors  such  as 
interest  in  flying,  a  desire  to  contribute  to  the  war  effort,  a  desire  for 
status  as  a  commissioned  pilot  with  its  attendant  increoso  in  pay  and 
privileges,  or  sometimes  only  a  desiro  to  obtain  the  better  living  condi¬ 
tions  that  prevailed  in  tho  Air  Forces  as  compared  w:th  other  branches 
of  tho  service.  Although  they  wero  well  motivated,  many  students 
had  an  apprehension  concerning  flight.  A  majority  of  students  wero 
tense  during  their  first  few  flights  and  this  tension  had  to  bo  ovcrcomo 
before  they  could  coordinate  as  smoothly  as  necessary  and  could  think 
clearly  whilo  flying. 

As  tho  first  flight,  each  now  student  was  given  a  20-minuto  orienta¬ 
tion  tour  of  tho  area.  Most  of  the  flying  was  straight  and  level  and 
tho  instructor  pointed  out  landmarks  in  a  calm  tone.  Even  so,  it 
was  a  tension-producing  experience  for  tho  student  to  fly  through  tho 
air  with  tho  roar  of  tho  engine  in  his  ears.  When  tho  piano  was 
banked,  many  new  students  leaned  to  ono  side  trying  to  remain  vertical 
to  the  ground  instead  of  remaining  in  tho  same  position  rclativo  to 
tho  airplane.  In  slight  down-drafts  the  airplano  tended  to  fall  away 
from  under  the  student  and  ho  felt  a  loss  of  support  oven  though  ho 
was  held  firndy  in  his  scat  by  the  safety  belt.  Tho  students  had  to 
become  used  to  theso  sensations  and  had  to  gain  confidcnco  in  tho 
airplano  and  tho  instructor. 

Tho  apprehension  concerning  flight  was  in  most  cases  soon  ovcr¬ 
como.  However,  new  maneuvers  wero  introduced  rapidly  and  tho 
student  had  to  work  hard  to  assimilato  the  material.  Officers  from 
Psychological  Research  Unit  No.  1  who  spent  six  weeks  at  an  army 
Primary  school  taking  flight  instruction  and  observing  tho  other 
students,  reported: 

“Tho  rapid  paco  of  tho  first  15  to  20  hours  of  instruction  leaves  ono 
with  tho  feeling  of  insufficient  understanding  of  wlmt  ono  is  doing  and 
of  insufficient  practico  in  doing  it.  Forty  minutes  of  dual  flight  daily 
(tho  scheduled  amount)  actually  means  25  or  30  minutes  in  tho  air, 
and  about  20  minutes  outside  the  traffic  pattern:  very  littlo  timo  for 
practicing  old  maneuvers  and  learning  ''0  new  ones  which  aro  intro¬ 
duced  every  two  or  tlirco  days.  It  is  after  about  15  such  flights  wit  l 
days  full  of  other  things  that  ono  must  solo.”  _ 

Some  students  wero  so  disturbed  by  flying  and  by  tho  rapid  paco  of 
training  that  they  requested  elimination.  Others  became  so  tenso 
that  they  wero  unablo  to  make  the  necessary  fino  kinesthetic  discrimi¬ 
nations  and  could  not  coordinato  properly.  Still  other  students  wero 
particularly  anxious  during  certain  maneuvers  so  that  they  forgot  what 
they  had  been  told  or  were  unablo  to  think  clearly,  look  around  end 
tako  into  account  all  of  tho  necessary  factors.  In  a  few'  cases  students 
wero  so  uneasy  about  certain  maneuvers  that  they  did  not  practico 
them  during  solo  flights  and  hence  fell  behind  their  clns.snmtes  w  ho  a 
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practice.  Thus  poor  coordination,  faulty  memory,  poor  headwork,  or 
Blow  progress  wore  in  some  eases  symptoms  of  emotional  disturbance 
rather  than  lack  of  aptitude.  Or.  the  other  hand,  students  who  be¬ 
cause  of  low  aptitude  found  it  difficult  to  control  tho  airplane,  were 
likely  to  bccomo  emotionally  upset. 

The  Four  Fundamentals  of  Flight:  Climbs,  Glides,  Turns,  Straight-and- 
Level 

It  was  frequently  said  that  the  four  fundamental  maneuvers  were 
climbs,  glides,  turns,  and  straight-and-levcl  flight,  and  that  all  other 
maneuvers  were  made  up  of  combinations  of  these  four.  Thcro  were 
a  few  exceptions  to  this  statement  but  a  student  who  could  perform 
these  four  basic  maneuvers  well  was  not  likely  to  havo  trouble  with 
other,  more  complex  maneuvers.  An  important  and  representative 
situation  where  these  four  aspects  of  flying  wero  all  necessary  was  in 
tho  practice  of  take-off  and  landing.  Therefore,  a  description  of  the 
take-off,  traffic  pattern,  and  landing  gives  a  fair  samplo  of  tho  prob¬ 
lems,  perceptions,  and  skills  necessary  for  tho  student  pilot  in  these 
important  maneuvers.  Tho  students  had  to  bccom*  proficient  in 
take-offs  and  landings  before  they  could  solo.  A  largo  proportion  of 
eliminations  occurred  between  tho  10th  and  17th  hours  of  flying 
training  bccauso  tho  students  could  not  learn  to  do  tho  take-offs  and 
landings  well  enough  to  solo. 

The  rectangular  traffic  pattern  used  for  take-offs  and  landings  is 
illustrated  in  figuro  3.1.  In  flying  this  pattern  tho  airplano  took  off 
upwind,  climbed  to  an  altitudo  of  300  feet,  leveled  off,  mado  a  level 
00°  turn  to  the  left,  climbed  on  up  to  traffic  altitude  of  500  feet  above 
the  ground,  then  turned  90°  to  tho  left  again  outside  tho  boundary 
of  the  field  and  flew  downwind  along  its  edgo  (downwind  leg)  until 
reaching  a  point  beyond  tho  downwind  end  of  tho  field.  Then  another 
90°  turn  to  the  left  was  mado.  Tho  airplane  then  flew  parallel  to  the 
end  of  the  field  (base  leg)  until  timo  to  turn  left  again  and  approach 
tho  field  in  a  glide  for  tho  landing.  In  order  to  make  the  airplane 
perform  this  apparently  simple  rectangular  pattern  with  tho  necessary 
degree  of  precision  and  safety,  tho  pilot  had  to  make  rapidly  a  number 
of  fine  perceptions,  inako  rapid  judgments  of  relative  speed  and  dis¬ 
tance,  and  exert  just  the  correct  control  pressures  in  the  right  sequence 
at  the  right  time.  This  will  bo  described  in  detail  in  tho  following 
paragraphs. 

Takt-ojJ  arul  climb  iojirst  turn.  After  tho  airplane  had  been  lined 
up  for  the  take-off  and  the  proper  checks  lmd  been  made,  the  student 
advanced  tho  throttle  smoothly  and  continuously  to  tho  full  open 
position.  As  tho  airplano  gathered  speed  tho  student  counteracted 
its  tendency  to  turn  to  tho  left 11  by  applying  right  rudder  and 
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simultaneously  judged  tho  correct  moment  to  allow  tho  airplano  to 
leave  the  ground. 

After  tho  airplano  was  off  tho  ground  20  feet  or  so  and  had  gained 
flying  speed,  the  student  throttled  back  slightly  and  held  it  in  a  climb¬ 
ing  attitudo  as  near  to  an  airspeed  of  70  m.  p.  h.  ns  ho  could.  All  tho 
while,  ho  hod  to  watch  for  other  airplanes  in  tho  pattern  and  nrnko 


euro  that  his  climbing  path  was  a  projection  of  his  take-off  run.  This 
last  was  particularly  necessary  because,  if  students  did  not  fly  parallel 
paths  on  take-off,  there  was  real  danger  of  mid-air  collision.  The 
straight  path  was  difficult  during  climbs  because  “torque"  produced 
a  left-turning  tendency  during  the  climb  ns  well  as  during  the  take-off 
and  the  airplane  had  a  tendency  to  drift  if  the  take-off  was  not  directly 
into  the  wind.  The  direction  of  tnkc-off  and  landing  was  determined 
in  Primary  school  by  the  wind  tee,  which  was  an  indicator  that  could 
be  set  on  one  of  the  eight  points  of  the  compass  and  was  pointed  as 
ncurly  upwind  as  possible.  Since  the  tee  had  only  eight  settings,  it 
was  not  always  pointing  directly  upwind  and  the  plane  might  have  a 
tendency  to  drift  sideways.  This  had  to  be  counteracted  by  a  slight 
turn  into  the  wind,  or  “crab."  Since  very  few  Primary  schools  had 
runways  for  student  use,  the  only  effective  way  for  the  student  to 
check  on  the  direction  of  his  climbing  path  was  to  look  back  at  the 
field  and  see  tho  wind  tee.  To  do  this  lie  had  to  turn  around  and 
look  long  enough  to  detect  any  drifting  tendency  and  still  keep  a 
sharp  lookout  for  other  nearby  Primary  trainers. 

It  was  important  that  the  student  throttle  back  and  maintain  the 
plane  at  the  most  efficient  climbing  speed  of  70  m.  p.  h.  If  tho  speed 
rose  much  above  this  the  airplane  would  not  bo  at  its  most  efficient 
climbing  speed  and  would  not  be  able  to  reach  the  traffic  altitude  of 
500  feet  at  the  proper  time.  If  the  air  speed  fell  too  much  below  70 
in.  p.  h.  there  was  danger  of  stalling  tho  airplano  at  such  a  low  altitude 
that  it  would  crash. 

It  can  be  seen  that  the  student  could  not  spend  much  time  watching 
the  air  speed  indicator.  It  was  necessary  for  him  to  train  his  per¬ 
ception  so  that  he  could  estimate  fairly  well  tho  air  speed  of  tho  air¬ 
plane.  The  student’s  cues  for  keeping  tho  airplane  at  tho  correct  air¬ 
speed  were:  tho  angle  between  the  nose  and  the  horizon;  tho  wliistlo 
of  the  struts;  tho  sound  of  tho  engine;  tho  stiffness  or  “mushincss" 
of  the  controls;  and  his  feeling  of  sustentation.  In  this  situation,  the 
perceptual  aspects  of  the  task  of  flying  wero  considerably  more 
difficult  than  the  motor  activities  necessary  to  correct  any  deviations 
from  the  desired  air  speed.  At  a  constant  power-setting  in  tho  climb, 
the  speed  of  the  plane  could  be  increased  by  a  slight  relaxation  of  back 
pressure  on  tho  stick.  Tho  crucial  aspect  was  the  perception  of  tho 
need  for  such  corrective  actions. 

The  Urd  90°  turn.— After  climbing  to  an  altitude  of  exactly  300  foot, 
the  student  leveled  off  and  made  a  level,  90°  turn  to  tho  left.  In  a 
turn,  the  stick  and  rudder  pressures  had  to  bo  coordinated  so  that 
the  plane  did  not  slip  or  skid  during  tho  turn.  In  a  medium-bank 
turn  to  left  tho  slight  leftward  pressuro  on  the  stick  was  coordinated 
with  just  enough  pressuro  on  tho  left  rudder  so  that  the  piano  camo 
around  smoothly  without  tho  noso  going  up  or  down  on  tho  horizon. 
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Too  mucli  rudder  pressure  would  make  the  airplane  skid  around  toward 
the  outside  of  tho  turn;  too  little  rudder  pressure  would  not  bring  it 
around  quickly  enough  and  make  it  slip  to  the  inside  of  the  turn. 
This  “coordination”  was  strongly  emphasized  by  instructors  prin¬ 
cipally  because  it  indicated  whether  the  student  had  tho  ability  to 
perceive  small  irregularities  in  the  airplane’s  flight. 

The  coordinations  necessary  for  rolling  into  a  turn  and  rolling  back 
to  level  flight  were  important  in  Primary  training  because  during  his 
later  training  the  student  might  have  to  fire  at  a  target  with  machino 
guns  that  were  fixed  to  the  nose  or  wings  of  his  airplane.  In  fixed 
gunnery  of  this  sort  excellent  coordination  was  necessary  so  that  tho 
bullets  would  strike  the  place  that  the  student  was  aiming  at  with  his 
gun  sights.  A  lack  of  coordination  produced  a  slip  or  skid  that  would 
cause  tho  bullets  to  go  wide  of  the  mark.  Good  coordination  also 
had  a  more  immediate  application  because  a  student  who  held  too 
much  bottom  rudder  in  a  gliding  turn  shortly  before  landing  was  likely 
to  put  the  plane  into  an  unexpected  spin  closo  to  the  ground  with 
insufficient  altitude  for  a  safe  recovery. 

The  principal  cue  for  this  coordination  was  the  feeling  of  being 
swayed  toward  one  side  or  the  other  in  a  slip  or  skid  in  much  the  samo 
way  that  a  person  feels  swayed  or  pulled  toward  the  outside  of  a  turn 
when  riding  in  an  automobile.  When  an  airplane  was  in  a  perfectly 
coordinated  turn,  the  pilot  felt  no  tendency  to  sway  to  either  side. 

After  the  student  had  coordinated  the  stick  and  rudder  pressures  to 
produce  the  degree  of  bank  that  was  necessary  for  a  turn,  the  controls 
were  neutralized.  The  airplane  was  then  kept  at  the  right  speed  and 
altitude  principally  with  the  elevators,  which  were  controlled  by  back 
and  forward  pressures  on  tho  stick.  Altitude  control  was  more  diffi¬ 
cult  in  turns  than  in  straight  flight  because  the  angle  of  bank  reduced 
the  effective  lift  and  because  the  airplane  would  lose  altitude  by  slip¬ 
ping  if  the  bank  was  not  properly  coordinated  with  the  rate  of  turn. 

If  tho  student  did  not  hold  enough  back  pressure  on  the  stick,  ho 
would  lose  altitude  rapidly.  If  the  student  held  too  much  back  pres¬ 
sure  ho  would  gain  altitude,  and  with  still  more  back  pressure  tho 
airplane  was  likely  to  stall  and  fall  irregularly  out  of  the  turn.  Thus, 
stick  pressure  and  altitude  control  in  the  turn  were  extremely  impor¬ 
tant.  As  described  more  completely  in  Chapter  0  on  the  Development 
of  Objective  Measures  of  Flying  Skill  at  the  Primary  Level,  altitudo 
control  was  found  to  be  one  of  the  best  measures  in  differentiating 
between  students  with  15  hours  of  training  and  a  greater  number  of 
hours  of  training. 

When  the  student  used  too  much  back  pressure  lie  could  tell  that  he 
was  gaining  altitude  by  the  increased  feeling  of  sustentation  or  lift. 
When  tho  airplane  approached  a  stall,  there  were  a  number  of  signs  of 
tho  approaching  stall.  Ono  of  them  was  increasing  looseness  of  tho 
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control*.  Just  before  the  stall  occurred  there  wad  a  characteristic 
shudder  and  “buffeting’  as  the  air  flow  over  the  wings  became 
irregular. 

If  the  student  acted  quickly  a*  soon  as  he  felt  the  airplane  shudder 
at  the  beginning  of  a  stall,  he  could  usually  increase  power  and  move 
the  stick  forward  in  time  so  that  the  airplane  would  not  stall  com¬ 
pletely  and  fall  out  of  the  turn.  This,  however,  required  instant 
recognition  of  the  shudder  and  immediate  movement  or  pressure  on.  tbe 
stick. 

Crtiiix'L'tnti  Ug,  <L)  ’cn  <o.n<l  Ug,  and  btute  Ug. — After  taking  off,  climb- 
ini:  to  300  feet  and  making  a  level  90°  turn  to  the  left,  the  student  flew 
the  airplane  crosswind  until  outside  the  boundary  of  the  held,  climb¬ 
ing  to  the  traffic  altitude  of  .500  feet.  The  climb  was  the  same  as  the 
chmb  previously  described,  but  in  this  case  the  student  had  to  crab 
into  the  wind  so  that  on  this  crosswind  leg  he  would  not  be  blown  back 
over  the  field. 

After  completing  the  crosswind  leg  the  student  pilot  turned  the  air¬ 
plane  90°  to  the  left  and  flew  downwind  outside  the  edge  of  the  field 
on  a  path  parallel  but  in  the  opposite  direction  to  the  one  on  which 
he  took  off  and  climbed.  This  was  the  downwind  leg  and  in  this  leg 
the  student  flew  straight  ami  level,  watched  out  for  other  airplanes 
and  selected  a  landing  spot.  Straight-and-level  flight  does  not  consist 
of  the  absence  of  change  but  consists  of  a  series  of  small  corrections  of 
altitude,  direction,  and  ground  track.  Much  as  an  automobile  driver 
continuously  makes  small  corrections  with  the  wheel  in  order  to  keep 
his  ear  in  the  correct  lane  on  a  road,  the  pilot  of  an  airplane  steers  in 
three  dimensions,  corrects  for  possible  drift,  and  keeps  a  sharp  lookout 
in  all  directions  since  other  airplanes  may  approach  him  from,  any 
angle  or  direction. 

In  straight-and-level  flight  the  pilot’s  attention  typically  went 
through  tluj  following  sequence:  The  pilot  turned  his  head  and  looked 
to  the  rear  at  the  left  of  the  airplane,  with  his  field  of  vision  including 
the  air  above  and  below.  He  then  looked  out  along  the  left  wing  to 
see  whether  it  was  level  and  in  the  correct  position  on  the  horizon. 
Following  this  he  looked  at  the  instrument  panel  and  cheeked  on  air¬ 
speed,  altitude,  and  engine  rpm  with  occasional  attention  to  fuel 
and  temperature  gauges.  If,  for  example,  all  was  in  order  except  for 
altitude,  he  again  looked  out  over  the  nose  while  making  a  slight  cor¬ 
rection  in  stick  pressure.  His  glance  then  traveled  around  to  the 
right,  checking  on  the  right  wing,  and  then  to  the  right  rear,  above 
and  below.  He  then  started  back  from  the  right  rear  to  the  right  wing, 
to  tlie  instruments,  and  at  that  time  checked  the  altimeter  to  see  if 
die  airplane  was  coming  back  to  the  correct  altitude.  The  student 
did  not  keep  watching  the  altimeter  during  the  correction  in  altitude. 
He  knew  that  if  he  did  that,  some  other  aspect  of  the  airplane’s  flight 
would  deviate  from  the  desired. 
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Final  Approach,  an*L  binding. — The  student  flew  on  the  downwind 
leg  until  he  was  about  a  quarter  of  a  mile  beyond  the  end  of  the  landing 
held,  then  made  a  90°  turn  to  the  left,  and  flew  crosswind  until  ready 
to  turn  in  toward  the  fluid  for  the  final  approach  and  landing.  The 
position  of  the  base  leg  was  varied  depending  upon  the  wind  velocity. 
With  a  higher  wind  the  base  leg  was  put  close  to  the  fluid  anti  with 
*  no  wind  the  base  leg  was  approximately  a  quarter  of  a  mile  from  the 
field.  It  was  necessary  for  the  student  to  crab  into  the  wind  on  the 
base  leg  in  order  to  maintain  a  ground  track  that  was  directly  cross- 
wind.  On  the  base  leg,  the  student  picked  out  the  spot  on  the  field 
where  he  planned  to  land  and  at  a  place  which  was  at  a  43°  angle 
from  the  desired  landing  spot  he  closed  the  throttle,  held  the  airplane 
in  a  cruising  attitude  until  it  slowed  to  gliding  speed  and  then  nosed  it 
down  into  a  glide.  Placing  the  base  leg  the  proper  distance  from  the 
field  and  cutting  the  throttle  at  the  proper  point  required  good  judg¬ 
ment  of  spatial  relations. 

The  desired  gliding  speed  for  the  Primary  trainer  was  73  to  SO 
m.  p.  h.,  which  gave  a  convenient  rate  of  descent  ami  a  safe  margin 
above  stalling  speed.  In  the  glide,  as  in  the  climb,  the  student  had  to 
be  careful  not  to  let  the  air  speed  get  too  low  because  of  the  danger  of 
a  stall.  If,  on  the  other  hand,  the  student  let  the  air  speed  get  too 
high,  the  airplane  would  not  land  upon  reaching  the  ground,  and  the 
student  would  have  to  skim  along  the  surface  for  an  excessive  distance. 
The  student  held  the  correct  gliding  attitude  and  air  speed  partly  by 
reference  to  the  air  speed  inilicator  but  mostly  by  other  cues,  because 
in  this  case  he  also  had  to  watch  for  other  airplanes  as  well  as  to  make 
plana  for  hia  landing.  The  cues  for  the  correct  gliding  attitude  and 
air  speed  were  the  position  of  the  nose  relative  to  the  horizon,  the 
sound  of  air  hissing  over  the  struts  and  fabric,  and  the  feel  of  the 
controls.  The  ability  to  perceive  and  correctly  interpret  those  cues 
was  considered  most  important  in  students  because  it  determined  to 
a  great  extent  the  safety  of  the  student  during  hia  final  approach  and 
landing  and  because  a  constant  gliding  speed  was  essential  to  good 
estimation  of  the  height-distance  relationship. 

On  the  final  approach  to  the  landing  field,  the  student  had  to  esti¬ 
mate  hia  point  of  landing  and  make  any  corrections  necessary  for 
“undershooting”  or  “overshooting.”  If  he  were  going  to  “under¬ 
shoot,”  i.  e.,  land  short  of  the  field,  he  opened  the  throttle  a  little  and 
the  airplane  gained  enough  speed  to  carry  him  into  the  field.  If  ho 
were  going  to  “overshoot,”  i.  e.,  land  beyond  the  middle  of  the  held, 
it  was  necessary  for  him  to  open  the  throttle  wide  and  gain  altitude, 
fly  over  the  field,  and  repeat  the  traffic  pattern  before  making  another 

try  at  landing. 

The  problem  of  estimating  the  probable  point  of  landing  a 
complex  one.  If  it  ia  assumed  that  the  airplane  was  in  the  desired 
75-80  m.  p.  h.  glide,  the  expected  point  of  binding  was  the  place  on 
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t lie  ground  toward  which  the  glide  path  of  the  airplane  was  directed. 
However,  this  was  not  easily  determined  because  the  nose  was  not 
pointed  directly  at  this  place  on  the  ground  hut  was  pointed  at  a  spot 
farther  on  because  of  the  nose-high  gliding  attitude  of  the  airplane. 
Many  students  learned  to  estimate  the  probable  spot  of  landing  by 
observing  during  the  glide  the  spot  which  had  no  tendency  to  move 
toward  the  edge  of  the  visual  field.  Since  the  student  was  gliding 
toward  the  ground  from  above,  all  objects  were  rapidly  becoming 
larger  and  those  not  on  a  projection  of  the  glide  path  were  moving 
out  toward  the  edge  of  the  visual  field.  Other  students  apparently 
did  not  use  this  kind  of  perception  but  made  their  judgments  from  the 
estimated  velocity  of  the  wind,  the  position  of  the  base  leg,  and  the 
altitude  of  the  airplane  just  before  the  final  turn  onto  the  approach  leg. 

On  the  final  approach  as  the  airplane  came  near  the  ground,  the 
student’s  problem  was  to  decide  at  just  what  altitude  above  the 
ground  to  start  increasing  the  back-pressure  on  the  stick  so  that  the 
airplane  would  not  lly  into  the  ground  but  would  approach  it  more 
and  more  gradually.  This  change  from  the  normal  gliding  attitudo 
and  air  speed  was  called  "breaking  the  glide.”  The  nir  speed  of  the 
airplane  was  gradually  reduced  ns  it  approached  the  gound  and  ideally 
thu  student  brought  the  airplane  closer  and  closer  to  a  full  stall  as  it 
approached  the  ground,  until  finally  the  airplane  was  stalled  with  all 
3  wheels  no  more  than  1  or  2  feet  above  the  ground.  Then,  ns  the 
airplane  stalled,  it  settle*!  down  to  a  perfect  3-point  landing.  In 
actual  practice  the  perfect  landing  just  described  was  the  exception 
rather  than  the  rule. 

Since  students  often  made  errors  ami  the  nir  was  usually  moving 
and  more  or  less  gusty  close  to  the  ground  most  landings  deviated 
from  tin*  perfect  one  to  n  greater  or  lesser  degreo. 

One  of  the  most  difficult  landing  problems  for  students  was  the 
binding  in  which  the  student  came  down  parallel  with  the  tee,  but  tho 
tee-setting  was  not  exactly  into  the  wind  so  that  it  blew  a  little  ucross 
the  path  of  the  airplane.  In  order  to  keep  from  drifting,  the  student 
had  to  slip  slightly  into  the  wind,  to  crab  slightly  into  the  wind,  or  a 
combination  of  both.  This  was  done  (hiring  the  approach  glide  and 
one  *>f  the  greatest  problems  for  the  student  was  to  determine  just  how 
much  slip  or  crab  to  use.  On  the  approach  glide  it  was  sometimes  diffi¬ 
cult  for  tin*  student  to  discriminate  between  a  slight  turn  and  a  small 
amount  of  drift.  If  he  was  able  to  do  this  and  to  crab  just  tho  right 
amount  so  that  the  ground  track  was  parallel  with  the  tee,  he  had  to 
remove  the  crab  at  the  last  moment  before  landing  or  the  airplane 
would  him!  slightly  sideways.  If  the  airplane  landed  this  way,  thero 
was  danger  that  the  landing  gear  would  be  damaged  or  that  it  would 
he  difficult  to  avoid  a  ground-loop.  On  the  other  hand,  if  the  crab 
into  the  cross  wind  was  removed  too  long  before  the  wheels  actually 
touched  the  ground,  the  slight  cross  wind  would  then  have  timo  to 
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drift  the  airplane  away  from  its  correct  ground  track  and  the  airplane 
would  be  moving  with  a  slight  sideward  component  which  would 
again  tend  to  damage  the  landing  gear  or  produce  a  ground-loop. 
Thus,  It  was  necessary  for  the  student  to  make  accurate  estimations 
of  the  degree  of  crab  necessary  to  compensate  for  the  slight  cross  wind, 
estimate  his  height  above  the  ground,  remove  the  crab  neither  too 
early  nor  too  late  in  the  landing  sequence,  and,  in  spite  of  tho  “inushi- 
ncss”  of  the  controls  at  this  low  speed,  to  turn  the  plane  straight  at 
the  last  moment  and  land.  This  was  a  difficult  skill  for  most  students, 
involving  as  it  did  accurate  perceptions  and  manipulations,  and  was 
one  of  the  maneuvers  in  which  the  student  hod  to  be  proficient  beforo 
he  could  solo. 

After  the  student  had  broken  the  glide  and  tho  airplane  was 
approaching  the  ground,  tho  student’s  problem  was  to  cstimato  tho 
height  of  tho  wheels  above  tho  ground,  to  bring  the  airplano  into  a 
3-point  stalled  position  beforo  letting  it  touch  tho  ground,  and  also 
not  to  stall  it  so  high  that  it  would  drop  in  with  a  jolt.  Tho  principal 
cue  for  the  correct  landing  attitude  of  the  airplano  was  the  angle 
between  the  nose  of  tho  airplane  and  the  horizon,  or  in  areas  where  tho 
horizon  was  indistinct  or  irregular,  the  angle  between  the  longitudinal 
a.\is  of  the  airplane  and  the  surface  of  tho  ground.  If  this  correct 
attitude  were  not  attained,  tho  wheels  of  the  airplane  wero  likely  to 
strike  the  ground  first,  and  produco  a  bounce  in  which  the  airplano 
rose  into  the  air  5  to  15  feet.  Tho  student  then  had  to  act  quickly, 
opening  the  throttle  briefly  so  that  the  airplane  would  not  drop  into 
the  ground  from  this  increased  height.  Some  students  wero  “ground 
shy’’  and  rarely  bounced  the  wheels  on  the  ground,  but  rather  stalled 
the  airplane  too  high  and  allowed  it  to  drop  several  feet  to  the  ground. 
This  had  to  be  avoided  because  of  tho  danger  of  breaking  tho  landing 
gear. 

Estimating  the  distance  of  tho  wheels  above  the  ground  was  ono  of 
tho  things  difficult  to  learn.  Tho  student  could  not  sec  tho  wheels, 
and  tho  ground  was  going  by  at  CO  to  70  m.  p.  h.  Tho  ground 
nearby  was  blurred  because  of  the  speed.  The  student  had  to  look 
farther  away  so  that  objects  would  not  be  blurred  but  not  so  far  away 
that  changes  in  the  visual  angle  subtended  would  be  too  small  to  mako 
perception  of  height  above  tho  ground  possible.  At  tho  same  time 
that  ho  was  making  these  perceptions  of  height  it  was  necessary  for 
the  student  to  hold  the  airplane  straight  and  to  keep  the  wings  level, 
so  that  ho  had  soverul  aspects  to  watch  ut  the  same  time.  Tho  degreo 
of  back  pressure  on  the  stick,  for  instance,  was  crucial.  It  had  to  bo 
brought  buck  slowly  enough  so  that  tho  uirplano  would  not  zoom 
back  up  into  the  air,  but  also  rapidly  enough  so  that  tho  uirplano 
would  uttuin  tho  correct  stulling  utlitude  and  speed  beforo  touching 
tho  ground. 

Even  after  tho  uirpluno  was  sot  down  in  a  throe-point  attitude,  tho 
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landing  was  not  completed  until  it  camo  to  a  full  stop.  Just  lifter 
touching  the  ('round  the  airplane  was  still  ('ring  50-55  m.  p.  h.  Tho 
student's  task  was  to  keep  rolling  straight  ahead  until  tho  airplane 
had  slowed  down  to  the  taxiing  speed  of  about  4  ni.  p.  h.  Tho  design 
of  the  Primary  training  plane  intentionally  made  this  a  difficult  task 
so  that  the  student  would  acquire  a  skill  required  later  in  tactical 
equipment.  7*he  front  wheels  on  the  Primary  trainer  were  set  fairly 
close  together  and  well  in  front  of  the  center  of  gravity  so  that  there 
was  an  unstable  equilibrium  and  without  considerable  enro  and  skill 
the  student  was  likely  to  “ground-loop"  the  plane.  In  a  ground-loop 
tho  nil  plane  turned  sharply  to  ono  side  or  tho  other.  Centrifugal 
force  was  then  likely  to  tip  it  over,  damaging  a  wing  tip  and  sometimes 
throwing  tho  airplane  up  onto  its  nose. 

The  students  were  advised  by  their  instructors  that  the  best  way 
to  prevent  ground  loops  was  to  stop  them  beforo  they  started.  This 
meant  that  the  student  had  to  observe  very  slight  deviations  of  the 
nose  to  one  side  or  the  other  of  the  straight  path  and  mako  tho  appro¬ 
priate  corrective  slight  rudder  pressures.  If  tho  noso  of  tho  airplane 
was  allowed  to  swing  more  than  slightly  to  ono  sido  or  tho  other,  the 
technique  of  correction  was  still  inoro  difficult.  Tho  student  could 
not  apply  corrective  pressure  to  the  rudder  and  then  hold  that  pressure 
until  tho  nose  of  tho  airplauo  came  back  to  tho  straight  path.  If  tho 
student  did  this,  tho  airplane  then  went  into  a  more  violent  turn  in 
tho  op|>osito  direction.  Tho  proper  tcchniquo  for  slopping  an  incipi¬ 
ent  ground  loop  was  to  apply  tho  proper  amount  of  opposito  rudder 
pressure  for  a  very  brief  period  of  time,  anticipating  the  effect  so  that 
the  airplane  swung  back  to  tho  correct  position  but  not  beyond  the 
correct  position.  The  difficulty  of  these  perceptual  and  motor  skills  was 
one  of  the  reasons  that  students  did  not  solo  sooner.  Finoadjustive 
reactions  with  the  feet  and  legs  were  not  part  of  the  student’s  previous 
activities.  They  could  bo  learned  but  it  was  difficult  and  took  time. 

The  relative  frequency  of  errors  in  tho  major  areas  of  difficulty  in 
landing  an  airplano  was  determined  in  a  study  dono  by  personnel  at 
Psychological  Research  Unit  No.  3.u  On  199  landings  performed  by 
88  Primary  students  tho  major  areas  of  difficulty  and  tho  percentage 
of  times  errors  occurred  in  theso  areas  wero  as  follows: 

o.  Not  stalling  out  correctly  (70  percent). 

6.  Not  keeping  headed  straight  on  tho  ground  ofter  landing 
(58  percent). 

c.  Not  breaking  tho  glido  at  tho  correct  height  (53  percent). 

ef.  Not  keeping  headed  straight  on  the  approach  leg  (51  percent). 

t.  Not  maintaining  proper  gliding  speed  in  tho  approach  (50 
percent). 

•  Till*  nu  Ijr  »m  bjr  C»|*.  Stuart  W.  Cook.  T/S|t.  Dark!  II.  Jtnkln\  l»rt.  Harold  II.  KtUr 

and  r*i.  fit  A.  U|>m*a. 
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The  take-off,  traffic  pattern,  and  landing  lmvo  been  considered  in 
some  detail  because  they  contained  a  wido  variety  of  problems  repre¬ 
sentative  of  many  phases  of  flying  skill.  For  this  samo  reason  tho 
maneuvers  were  particularly  important  in  the  training  of  tho  student 
and  were  among  his  principal  problems. 

To  summarize  this  section,  in  the  take-off,  traffic  pattern,  and  land¬ 
ing,  the  student  had  a  variety  of  tasks  which  had  to  bo  performed  at 
such  a  fast  pace  that  before  the  habits  boenmo  automatic  it  was  somo- 
wlmt  like  juggling  too  many  balls  in  tho  air  at  the  samo  timo.  It  was 
easy  for  the  student  to  become  confused  and  “go  to  pieces,"  sometimes 
making  mistakes  on  usually  simplo  tasks.  In  tho  short  spaco  of  0  to 
10  minutes  tho  students  had  to  do  the  following:  from  idling  speed, 
advanco  tho  throttle  smoothly  and  continuously  to  full  throttlo;  hold 
tho  airplane  straight  during  tho  take-off  run,  counteracting  tho 
torque-produced,  left-turning  tendencies;  fly  the  airplane  off  tho  ground 
correctly,  neither  pulling  it  off  too  soon  nor  holding  it  on  too  long; 
after  flying  speed  was  reached,  throttlo  back  to  a  climbing  power 
setting;  adjust  the  throttle-set  ting  and  climbing  attitudo  of  tho  air¬ 
plane  so  that  the  airplane  climbed  at  an  air  speed  of  70  in.  p.  h.; 
make  suro  that  tho  climbing  path  was  still  parallel  with  tho  take-off 
path  and  tho  tee;  keep  a  constant  lookout  for  other  airplanes  which 
might  also  bo  taking  off ;  watch  the  altimoter  so  that  ho  could  mako  & 
level  90°  turn  to  tho  left  at  300  feet  abovo  tho  ground;  continue  climb¬ 
ing  on  tho  crosswind  leg  until  tho  traffic  nltiludo  of  500  feet  lmd  been 
reached;  make  another  90°  turn  to  tho  left  onto  tho  downwind  leg, 
keeping  a  close  watch  that  ho  was  at  least  500  feet  from  any  other  air- 
piano  in  traffic  pattern;  during  tho  downwind  leg  maintain  tho  correct 
altitude,  heading,  engine  r.  p.  m.  and  airspeed,  while  taking  into  account 
the  direction  and  velocity  of  tho  wind  in  planning  how  far  out  from  tho 
field  to  put  the  base  leg  and  whero  ho  should  land;  mako  another  90° 
turn  to  tho  left  onto  the  base  leg,  placing  tho  huso  leg  in  such  a  posi¬ 
tion  that  the  airplane  could  then  land  in  tho  first  third  of  tho  landing 
field;  crab  into  tho  wind  enough  on  tho  baso  leg  so  that  tho  ground 
track  was  correctly  crosswind ;  closo  tho  throttlo  at  tho  correct  placo 
on  tho  base  leg  so  that  landing  in  tho  desired  placo  on  tho  field  would 
be  possiblo;  continue  holding  tho  oirplano  level  after  tho  throttlo  was 
cut  until  tho  speed  had  been  reduced  to  tho  correct  75-SO-m.  p.  h. 
gliding  speed,  then  noso  down  into  tho  proper  gliding  attitudo;  kcop  a 
sharp  lookout  fo-  her  airplanes  in  tho  pattern  that  might  bo  landing; 
mako  tho  90°  let*,  gliding  turn  townrd  tho  field  so  that  tho  airplane 
would  start  its  final  approach  in  tho  desired  landing  lano;  maintain 
tho  gliding  path  on  tho  final  approach  parallel  with  tho  tee,  oven 
though  tho  wind  might  bo  blowing  from  a  little  to  ono  sido;  maintain 
tho  correct  75-80-m.  p.  h.  gliding  speed,  using  cues  of  "feel  of  tho 
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controls/'  Bound  of  air  hissing  over  struts  and  fabric,  and  attitudo  of 
the  plane;  estimate  the  probable  point  of  landing  and  apply  enough 
more  throttle  if  it  was  not  safely  inside  the  field;  glido  on  down,  main¬ 
taining  the  correct  air  speed,  until  timo  to  “break  the  glido"  and  begin 
the  landing;  bring  tho  airplane  down  closo  to  tho  ground,  still  main¬ 
taining  crub  if  there  was  a  slight  crosswind,  and  taking  off  tho  crab 
at  the  last  moment  before  the  airplano  was  fully  stalled  and  settled 
to  the  ground;  and  hold  tho  stick  full  back  after  landing  to  keep  the 
tail  on  the  ground,  while  watching  closely  in  order  to  prevent  ground- 
loops.  \\  hen  all  of  this  had  to  bo  done  rapidly  and  accurately  during 
a  crowded  G  to  10  minutes,  it  can  be  seen  that  in  addition  to  the 
perceptual  and  motor  skills  involved,  the  student  ocedcd  to  bo  able 
to  divide  bis  attention,  or  at  least  rnako  rapid  shifts  of  attention 
with  rapid  decisions,  while  keeping  a  complex  of  other  factors  in  mind. 

Ollier  Maneuvers  Taught  at  Primary  School 

While  many  other  maneuvers  wero  taught  during  Primary  training, 
they  were  for  the  most  part  made  up  of  tho  samo  fundamental  ele¬ 
ments  of  flying  skill  that  the  student  used  in  tho  take-off,  traffic 
pattern,  and  landing.  In  aerobatics  it  was  necessary  for  tho  student 
to  maintain  orientation,  to  have  good  timing,  and  a  good  “feel  of  the 
airplane."  However,  few  students  who  wero  good  in  the  other  aspects 
of  flying,  were  eliminated  for  lack  of  proficiency  in  aerobatics.  One 
maneuver,  the  chandcllc,  which  wns  a  special  kind  of  180®  steep, 
climbing  turn,  made  more  demands  on  tho  student  than  tho  ordinary 
180°  steep  turn.  It  was  particularly  nccessaiy  for  tho  student  to 
have  a  good  speed  sense,  to  coordinate  properly,  and  to  bo  ablo  to 
sense  tho  approach  of  a  stall.  Because  of  this,  some  students  who 
had  only  minimum  proficiency  on  earlier  maneuvers  showed  up  their 
weaknesses  more  clearly  in  a  chandcilo  and  bccamo  candidates  for 
elimination.  However,  there  appeared  to  bo  no  fundamentally  new 
psychological  demands  on  the  student  in  theso  or  other  later  maneuvers. 

INVESTIGATIONS  BASED  ON  ELIMINATION  FROM  PRIMARY 
PILOT  TRAINING  FOR  LACK  OF  FLYING  SKILL 

The  various  units  in  the  psychological  program  carried  out  a  number 
of  investigations  which  threw  light  on  the  pilot’s  task.  Most  of  theso 
were  studies  of  the  reasons  for  eliminations  from  Primary  pilot  train¬ 
ing.  One  series  of  studies  wns  concerned  with  tho  reasons  given  by 
flying  instructors  for  eliminating  Primary  students.  Theso  reported 
reasons  were  classified  and  grouped,  and  a  rating  scale  based  on  theso 
groupings  was  studied  in  relution  to  subsequent  elimination  from 
Primary  training.  Another  larger  area  of  investigation  was  tho  one 
on  classification  tests,  all  of  which  wero  validated  against  graduation 
or  elimination  from  Primary  school  to  determine  their  vnluo  for  pre¬ 
diction  of  success  in  pilot  training.  Tho  work  on  the  classification 
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tests  is  reported  in  reports  No.  4  and  No.  5  of  this  series.  They  arc 
not  discussed  in  detail  in  this  chapter.  A  third  area  concerned  with 
the  pilot’s  task  was  the  development  of  objective  measures  of  flying 
skill  for  the  Primary  level.  This  is  described  in  Chapter  6. 

Analysis  of  Reasons  for  Elimination  from  Pilot  Training 

When  a  student  was  eliminated  from  one  of  the  pilot  training  schools, 
a  summary  was  prepared  of  tho  reasons  why  ho  had  failed  to  mnko 
successful  progress  in  learning  to  fly.  Field  studies  showed  that  theso 
summaries  usually  were  prepared  with  an  eye  toward  justifying  a 
decision,  which  had  already  been  made,  and  staving  oil  criticism  in 
any  future  investigation.  They  almost  always  made  a  very  strong 
ease  against  the  student.  Nevertheless,  the  factors  mentioned  wero 
probably  related  to  tho  most  common  difficulties. 

In  a  study  prepared  by  tho  Psychological  Branch,  Research  Divi¬ 
sion,  Oflicc  of  the  Air  Surgeon,  an  analysis  of  these  reports  was  mndo  in 
order  to  determine  the  nature  and  frequency  of  various  reasons  that 
were  given  as  causes  of  elimination.  A  preliminary  analysis  was  mado 
of  theso  reports  for  300  students  who  were  eliminated  from  flying 
training  during  the  early  part  of  the  summer  of  1941.  On  the  basis  of 
tho  categories  determined  in  the  preliminary  study,  a  more  complcto 
analysis  was  mado  of  1,000  additional  cadets  who  wero  eliminated 
during  tho  summer  and  fall  of  tho  same  year. 

Tho  frequency  with  which  various  reasons  were  given  for  elimina¬ 
tion  of  tho  1,000  cadets  used  in  the  major  study  is  shown  in  tnblo  3.1. 
The  data  arc  expressed  as  the  percent  of  cases  out  of  the  total  in  which 
at  least  one  comment  was  made  in  a  given  category.  If  tho  same 
reason  for  elimination  was  mentioned  moro  than  onco  for  a  given 
cadet  it  was  tubulated  only  once,  so  that  the  data  show  only  that  a 
trait  was  mentioned,  and  not  whether  it  was  mentioned  once  or  moro 
than  once  for  a  given  man. 

In  interpreting  this  table,  tho  fact  that  a  trait  is  frequently  mcn- 
t.oned  can  safely  bo  taken  to  mean  that  it  was  important,  but  any 
comparisons  between  the  number  of  times  different  traits  nro  men¬ 
tioned  must  be  mado  with  reservation.  The  number  of  times  a  trait 
was  mentioned  is  a  function  of  the  broadness  of  its  definition  (for  exam¬ 
ple,  “Progress  in  Developing  Technique”)  and  of  tho  ease  with  which 
the  instructor  could  dingnoso  it  as  nn  underlying  causo  of  difficulty. 
The  significant  finding  was  that  such  a  large  variety  of  traits  wero 
mentioned  relatively  frequently.  Frequent  mention  was  mndo  of 
tfnits  which  the  investigators  grouped  into  the  following  broad  cate¬ 
gories:  Coordination  and  Technique,  Alertness  and  Observation, 
Intelligence  and  Judgment,  and  Personality  and  Tempera  men  t. 

As  n  result  of  this  study  n  20-item  rating  scale  was  made  up  on 
which  the  instructors  in  Primary  school  rated  each  of  their  students. 
This  scnlo  (Rating  Seale  for  Avintion  Cadets — Form  C — Pilot),  which 
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lmd  added  a  general  over-all  rating  to  make  the  number  of  items  21, 
was  also  used  as  a  check  list.  For  those  students  who  wero  eliminated 
from  pilot  training,  the  flight  instructors  were  directed  to  indicato  each 
trait  the  lack  of  which  was  important  os  a  causa  of  elimination.  This 
was  done  in  addition  to  the  regular  ratings.  Students  eliminated  for 
physical  deficiency  or  for  administrative  reasons  were  excluded  from 
this  study. 

In  a  study  performed  by  tho  Psychological  Section,  Offico  of  the 
Surgeon,  Headquarters,  Flying  Training  Command,  tho  frequency 
with  which  each  of  tho  twenty  items  was  checked  was  obtained  on 
1,303  cadets  eliminated  from  Primary  pilot  training. 

Tablr  3.1 — The  percentage  of  a  group  of  one  thousand  aviation  cadett  eliminated 
from  primary  flying  schools  in  the  latter  part  of  10^1  for  which  deficienciei  in  then 
categuriei  were  lilted  at  a  reason  for  elimination  in  the  report  of  the  faculty  board 


cmtnn  Pmnt  • 

A.  InTKMJOKNCK  AND  Jo  DOM  EXT . . .  68 

1.  Judgment. — Ability  to  mako  sound  judgments  and  choices  as  to  the 

bi't  thing  to  do  when  ho  Ls  faced  with  a  pratticai  problem  in 
traffic,  in  making  forced  landing*,  and  in  similar  situations.....  60 

2.  Foresight  and  Planning. — Ability  to  plan  a  scries  or  sequence  of 

maneuvers,  plan  ahead  for  landings,  plan  entry  or  exit  from 
traffic,  and  forocc  and  avoid  possible  difficulties .  38 

3.  Memory.— Ability  to  remember  instructions  from  day  to  day,  both 

gc ncral  cxplanat ions  and  specific,  det ailed  information . ........  24 

4.  Comprehension. — Ability  to  understand  and  grasp  tho  meaning  of 

explanations,  instructions,  and  demonstrations,  cither  when  they 

arc  given  orally  or  in  written  form . .  17 

D.  Alkrtnksh  and  Obskhvatiox .  70 


6.  Visualisation  of  flight  course. — Ability  to  "get  out  of  tho  cockpit” 
and  fly  the  piano  with  refcrcnco  to  tho  horizon  and  reference 
|K)int*,  as  shown  by  tho  ability  to  handle  ground  pattern  work, 
maintain  constant  altitude,  control  tho  direction  of  tho  plane, 


mnke  turns  of  the  desired  amount,  etc .  36 

6.  Estimation  of  speed  and  distance. — Ability  to  make  such  estimates  of 

s|>ccd,  distance,  and  nititudo  as  are  required  in  flying  a  course, . 
flying  in  formation,  gliding,  landing,  cto....... . .  30 

7.  Sense  of  suslentation. — Ability  to  sense  support  or  lack  of  support 

of  tho  plane,  and  thus  detect  slips,  skids,  or  tho  approach  of  a 
stall... .  24 

8.  Division  of  attention. — Ability  to  remain  alert  and  observant  of 

thing*  around  him  while  flying  and  at  tho  same  timo  attend  to 
all  tho  necessary  details  and  carry  on  all  the  different  activities  • 

necessary  for  precision  flying.. . 28 

0.  Orientation. — Ability  to  find  his  correct  geographic  position  by  the 
use  of  any  avaitahlo  menns,  such  os  familiar  reference  points 
whirh  arc  visiblo  on  tho  ground,  identification  of  tho  area  below 

as  it  U  represented  on  charts  or  maps,  cte . .  13 

10.  Speed  of  derision  and  reaction. — Ability  to  think  quickly,  to  make 
rapid  decisions,  or  to  respond  with  sj>ced  and  precision  when  the 
situation  demands............... . 16 
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Table  3.1 — The  percentage  of  a  group  of  one  thousand  aviation  cadets  eliminated 
from  primary  flying  schools  in  the  latter  part  of  I04t  for  which  deficit  nee  s  in  these 
categories  were  listed  as  a  reason  for  elimination  in  the  report  of  the  faculty  board 


—Continued 

Cut  for f  Prrttnl 

C.  Coonc ination  and  Technique.. . . . .  81 

11.  Coordination. — Ability  to  Apply  the  correct  pressures  to  the  controls 
either  in  combination  or  in  tho  proper  scqucnco  and  with  proper 
timing,  os  evidenced  by  the  way  in  which  ho  uses  together  all  e  l 
the  controls  necessary  in  flying  the  plane . . . . . ...  (8 


13.  Appropriateness  of  controls  used. — Knowledge  of  what  control  or 
combination  of  controls  should  bo  used  at  any  particular  time 
while  (lying  and  tho  ability  to  respond  by  operating  theso  con¬ 
trols  so  ns  to  achieve  the  desired  result  in  relation  to  the  attitude 


of  the  plane . . . .  21 

13.  Feel  of  the  controls. — Ability  to  sense  the  responsiveness  of  tho  piano  to 

control  movement,  or  tho  effect  being  produced  on  tho  piano  by 
various  control  pressures  and  by  tho  ability  to  detect  stiiTnoss  or 
“musliincss"  of  the  controls.. . . . .  2 

14.  Smoothness  of  control  movement. — Ability  to  operate  the  controls  with 

smooth,  oven  movements  and  good  touch  control,  without  evi¬ 
dence  of  roughness,  heaviness,  or  jcrkincss..... . .  22 

15.  Progress  in  developing  technique. — Ability  to  learn  rapidly  the 

various  coordinations  of  tho  controls  and  techniques  necessary  for 

flying  tho  plane . . . . . .  54 

D.  Personality  and  Temperament... . .  43 

10.  Absence  of  tenseness. — Freedom  from  unduo  tenseness  or  rigidness, 

ability  to  relax  sufficiently  while  flying . .  22 

17.  Absence  of  confusion  and  nerrousness. — Ability  to  remain  cool  and 

collected,  and  to  think  and  act  without  interference  from  anxioty 
or  emotion  when  faced  with  emergency  or  a  difficult  situation  .  .  12 

18.  Absence  of  fear  and  apprehension. — Presence  of  a  dcsirablo  amount 

of  scif-confidcncc,  courage,  and  aggressiveness,  with  tho  absence 

of  timidity,  cautiousness,  or  any  strong  fear  of  flying.. . ...•  18 

10.  Suitable  temperament. — Possession  of  a  stablo  and  well-balanced 
temperament,  with  abscnco  of  careless,  erratio  and  shiftless 

habits.. . . . . .  0 

20.  Motivation  and  attitudes. — Strong  interest  in  aviation  and  dcslro  to 
be  a  military  pilot,  as  shown  by  his  effort,  eagerness  to  learn,  will* 
Ingness  to  respect  flying  rules  and  regulations,  and  his  determina¬ 
tion  to  make  good.................. _ ....................  6 


A  comparison  of  tho  frequency  with  which  each  item  was  checked 
on  tho  rating-scolo  check-list  with  tho  frequency  with  which  it  was 
mentioned  by  instructors  in  tho  study  previously  described  shows  that 
0  of  tho  20  traits  had  a  frequency  of  30  percent  or  greater  in  both  of 
theso  studies. 

In  an  earlier  study  performed  by  tho  Field  Studies  Unit  of  tho 
Psychological  Section,  Oflico  of  tho  Surgeon,  Hq.  AAF  Training 
Command,  it  was  found  that  when  instructors  rated  their  students  at 
tho  8-10  hour  level  each  of  tho  abovo  traits  had  a  biserial  correlation 
with  graduation-elimination  of  0.G0  or  better,  with  tho  exception  of 
Coordination  which  had  a  biscrial  correlation  of  0.55.  * 
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These  six  traits  nnd  their  biscrinl  correlations  with  Primary  gradua¬ 


tion-elimination  wero: 

r*i» 

1.  Judgment . . . . . .  0.66 

2.  ForeM'^ht  and  planning _ - —  .67 

3.  Visualization  of  flight  courts - ..... - -  .73 

4.  Intimation  of  ►peed  and  distance..  ........  ...........  .62 

5.  Coordination _ _ _ _  .65 

fi.  Progress  in  developing  technique.. _ ................  .68 


Hensons  /or  elimination  reported  by  eliminated  cadets. — A  total  of 
150  students  who  had  been  eliminated  from  pilot  training  were  inter¬ 
viewed  at  Psychological  Research  Unit  No.  3  in  order  to  secure  data 
on  the  students’  impressions  regarding  factors  involved  in  their  failure 
in  training.  Although  the  factors  cited  by  the  students  wero  un¬ 
doubtedly  not  nil  of  the  ones  involved  in  their  failure,  it  seemed  rea¬ 
sonable  to  assume  that  these  factors  were  valid.  That  is,  a  cadet 
may  have  failed  to  recognize  some  of  his  problems  or  mistakes,  but 
when  he  did  recognize  a  weakness  in  himself  or  a  problem,  it  seems 
likely  that  lie  was  citing  a  valid  reason  or  part  of  a  reason  for  his  fail¬ 
ure.  Of  course,  the  possibility  of  a  large  amount  of  rationalization 
must  bo  recognized. 

In  each  interview  an  attempt  was  made  to  get  an  impression  of  the 
student’s  emotional  reaction  to  his  elimination.  Although  emotionally 
disturbed  by  their  failures,  the  majority  (60.6  percent)  recognized 
that  their  mistakes  or  shortcomings  wero  responsible  for  their  elimi¬ 
nation.  However,  27.4  percent  were  strongly  disappointed  and  showed 
resentment  toward  tho  persons  and  regulations  involved  in  their 
elimination.  It  is  interesting  to  note  that  10  percent  of  tho  group 
were  emotionally  relieved  to  bo  eliminated.  Nervousness  and  fear 
mado  flight  training  very  unpleasant  to  these  men,  nnd  they  were 
glad  to  get  out  of  it.  Tho  remaining  2  percent  accepted  their  elimi¬ 
nation  without  disappointment  or  any  strong  emotional  reaction. 
They  seemed  to  tnko  an  objcctivo  point  of  view  regarding,  their  dis¬ 
abilities. 

Failure  in  training  did  not  convinco  these  men  that  they  could  not 
fly  nor  did  it  eliminate  their  desiro  to  be  pilots,  for  S6  percent  stated 
that  they  still  would  liko  to  tnko  pilot  training.  The  remaining  14 
percent  definitely  were  no  longer  interested  in  pilot  training,  although 
most  of  them  wanted  to  bo  given  some  other  assignment  that  would 
take  them  into  tho  air. 

l  a  tho  following  paragraphs  tho  typo  of  problem  is  given  os  tho 
ho  lding  nnd  tho  perccntngo  of  tho  150  students  giving  this  typo  of 
problem  as  one  reason  for  their  elimination,  follows  in  parentheses. 
Tho  various  problems  aro  presented  nnd  discussed  in  tho  order  of 
percent  frequency  with  which  they  wero  mentioned  by  tho  eliminated 
students,  starting  with  tho  most  frequent. 

1.  Nervousness  in  the  air  (64  percent). — This  problem  was  admitted 
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by  54  percent  of  this  group,  although  it  is  probablo  that  there  oro 
many  who  were  nervous  and  did  not  admit  it.  Nervousness  was 
caused  for  39  percent  of  the  total  group  by  fear  of  the  air.  Half  of 
these  men  claimed  they  became  adapted  to  the  air  in  n  few  hours  of 
flying  time  but  that  apprehension  during  the  first  stages  of  flight 
training  interfered  with  their  learning  and  probably  resulted  in  slow 
progress  from  the  start.  The  other  half  of  the  group  admitted  that 
they  never  succeeded  in  overcoming  their  fear  and  that  the  fear  was 
a  definite  factor  in  their  elimination.  It  is  also  possiblo  that  lack  of 
proficiency  was  one  of  the  causes  of  fear  with  some  of  theso  men.  It 
is  interesting  to  note  that  fear  seemed  to  occur  most  commonly  in 
landing  and  in  maneuvers  such  as  stalls  in  which  the  air  suddenly 
ceased  to  support  the  airplane.  In  landings,  it  seems  probnble  that 
visual  cues  of  speed  and  visual  reminders  that  the  airplane  was  off 
the  ground  were  much  clearer  than  when  tho  airplane  was  several 
hundred  feet  above  the  ground. 

Fear  of  failure  made  15  percent  of  tho  men  nervous  in  tho  air. 
Some  men  were  very  anxious  to  be  pilots  but  doubted  that  they  were 
going  to  be  successful  in  training.  For  others,  the  conflict  was  between 
a  strong  desire  to  prove  that  they  were  superior  (or  maintain  their 
prestige  in  tho  group)  and  a  fear  or  doubt  thnt  they  wero  not  going  to 
succeed.  Nino  percent  of  the  total  group  admitted  that  they  wero 
particularly  nervous  on  check-rules. 

2.  Slow  progress  ( 63  percent). — With  very  few  exceptions,  tho  stu¬ 
dents  seemed  to  lack  insight  into  the  causes  of  their  slow  progress, 
and  the  number  of  factors  that  could  bo  involved  were  almost  un¬ 
limited.  It  seems  unlikely  that  a  gencrnl  slow  rate  of  learning  was 
characteristic  of  all  theso  students’  activities.  It  seems  more  probablo 
that  these  students  had  trouble  with  one  or  two  phases  of  their  flight 
training.  For  example,  if  a  student  were  poor  on  landing  he  might 
fail  to  solo  within  tho  required  time  and  be  eliminated  for  slow  or 
inadequate  progress,  in  spite  of  the  fact  that  progress  on  other  phases 
of  flying  was  relatively  satisfactory.  “Slow  progress”  is  a  reason  fre¬ 
quently  given  by  instructors  and  students  but  too  broad  a  category 
to  be  of  much  uso  in  psychological  analysis. 

3.  Judgment  oj  height  and  speed  in  landing  ( SO  percent). — Errors  of 
judgment  in  landing  resulted  frequently  in  undershooting  or  over¬ 
shooting  tho  field,  landing  too  fast,  and  stalling  or  pulling  tho  stick 
back  when  too  high  oil  the  ground.  As  described  in  on  earlier  section 
of  this  chapter  tho  student  had  to  mako  a  number  of  complex  per¬ 
ceptual  judgments  and  fine  motor  adjustments  in  landing,  which  were 
undoubtedly  too  difficult  or  too  numerous  for  a  number  of  tho  students, 
particularly  at  tho  rato  at  wliich  they  were  expected  to  learn. 

4.  Lack  oj“JeeloJ  the  ship ”  (27  percent). — This  involved  inability  to 
senso  that  tho  airplano  was  approacliing  n  str.ll,  or  that  it  was  losing 
or  gaining  altitudo,  or  that  it  was  turning  w  hen  tho  student  thought 
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it  wns  flying  straight,  or  tlmt  it  was  banked,  or  that  it  was  banked  to 
a  greater  or  lesser  degree  than  the  student  thought  it  wa9,  or  that  the 
airplane  wns  skidding  or  slipping.  Probably  kinesthetic  and  visceral 
sensitivity  to  movement  and  loss  of  support  wns  important  hero  in 
addition  to  the  visunl  and  auditory  cues  described  earlier.  Some 
students  may  have  been  deficient  in  these  kinds  of  sensitivity  or  they 
may  never  have  been  in  situations  whero  they  had  to  learn  to  pay 
attention  to  these  kinds  of  sensations. 

fi.  Inappropriate  atlitwles  (2b  percent). — This  refers  to  any  attitude 
which  interfered  with  t,  cadet’s  progress  in  flight  training.  The 
principal  attitudes  under  this  heading  arc  os  follows,  together  with 
tho  percent  of  the  total  group  giving  these  as  possible  reasons  for 
elimination:  hostility  toward  instructor  (7  percent),  lack  of  interest 
in  flying  (7  percent),  lack  of  confidcnco  (5  percent),  overconfidence 
(4  percent),  recklessness  (3  percent),  worry  over  personal  problems 
(2  percent). 

0.  Poor  control  oj  the  airplane  in  landing  roll  (23  percent ). — As  pre¬ 
viously  stated  the  airplane  wns  still  difficult  to  control  after  the  wheels 
had  been  set  on  tho  ground  in  landing.  Tho  landing  roll  had  to  be 
kept  straight  and  it  wns  necessary  to  avoid  ground  loops.  It  is 
interesting  to  note  that  7  percent  of  tho  total  group  reported  that  they 
ground-looped  at  least  once  during  their  pilot  training  before 
elimination. 

7.  Instructional  problems  (20  percent). — Theso  students  considered 
that  their  instructors  were  not  good  teachers.  Students  frequently 
made  the  statement  “My  instructor  is  on  excellent  flyer  but  ho  can’t 
teach.”  Other  criticisms  which  may  or  may  not  have  been  objectively 
correct  but  which  were  reported  by  cadets,  were:  failure  of  tho  instructor 
to  tench  tho  student  n  maneuver  for  which  ho  was  held  responsible  on 
check  ritles;  assumption  by  the  instructor  that  the  student  knew  more 
thnn  he  did  about  flying,  especially  in  eases  whero  instructors  were 
changed;  failure  of  tho  instructor  to  point  out  to  tho  student  tho 
errors  he  wns  making;  insistence  upon  a  rigid  progress  schcdulo  with¬ 
out  attempt  to  adjust  the  schedule  to  individual  differences  in  learning 
rates  or  methods. 

8.  Division  oj  attention  and  memory  (19  percent). — Tho  student  had 
to  attend  to  a  variety  of  factors,  including  instruments,  visual, 
kinesthetic,  ami  auditory  cues  from  tho  nirplnno  itself,  tho  directions 
received  from  the  instructor,  and  stimuli  outsido  tho  nirplano,  such  as 
clouds,  other  airplanes,  tho  ground,  signals,  etc.  To  overlook  or 
misinterpret  ono  aspect  of  this  complex  pattern  might  causo  a  serious 
error  in  handling  tho  nirplano. 

9.  Stick  and  rudder  control  (17  percent). — This  wns  inability  to  handle 
the  stick  and  rudder  with  precision  and  accuracy.  This  difficulty  wns 
encountered  more  frequently  with  tho  rudder  than  with  tho  stick. 
From  tho  comments  of  tho  students  it  appeared  that  this  problem 

46 


occurred  for  many  bccauso  they  could  not  judge  tho  position  nor  extent 
of  movement  of  their  arms  and  feet  when  forced  to  depend  solely  on 
kinesthetic  and  tactual  cues.  For  example,  several  complained  that 
they  were  inaccurato  in  handling  tho  rudder  bccauso  they  could  not 
see  their  feet,  although  tho  stick  was  within  their  visual  field. 

10.  Visualization  oj  the  airplane's  orientation  and  behavior  in  space 
(16  percent). — Some  of  the  students  who  experienced  this  problem  said 
that  they  could  not  translate  tho  verbal  directions  of  tho  instructor 
into  a  visual  imago  as  to  what  the  airplane  should  do,  or  could  not 
translate  instrument  readings  into  an  image  of  whet  tho  airplano  was 
doing,  or  could  not  pcrccivo  the  relation  between  pressures  on  tho 
controls  and  the  behavior  of  tho  airplano  in  spaco. 

11.  Judgment  (16  percent).— Tho  moro  common  types  of  errors  of 
judgment  listed  by  these  investigators  included:  flying  too  closo  to 
other  planes,  turning  while  too  near  tho  ground,  erring  in  selection  of 
landing  fields  in  forced  landings,  flying  too  low,  flying  over  prohibited 
areas,  and  flying  into  or  too  closo  to  clouds.  In  a  few  cases,  reckless¬ 
ness  or  tho  desire  for  thrills  was  the  factor  behind  poor  judgment. 
Somo  of  the  men  said  flying  at  a  higher  altitude  did  not  givo  them  a 
feeling  of  speed  nor  provide  as  much  of  a  thrill  as  flying  near  the 
ground. 

12.  Motor  coordination  (IS  percent). — Tho  difficulty  hero  seemed  to 
bo  an  inability  to  move  tho  arms  and  legs  simultaneously  in  different 
directions,  although  what  was  called  poor  motor  coordination  was  in 
somo  cases  a  lack  of  insight  into  tho  relation  between  pressuro  on  tho 
controls  and  tho  airplano’s  behavior  or  lnck  of  perception  of  balanco 
rather  than  poor  motor  coordination  itself. 

13.  Erratic  performance  (IS  percent). — Thoso  students  said  that 
they  could  do  well  on  one  day  but  very  poorly  tho  next  day  for  no 
reason  they  could  determino. 

14.  flight  planning  and  traffic  pattern  flying  (IS  percent). — Somo  of 
the  students  could  not  plan  a  flight  from  one  point  of  space  to  another 
and  wero  also  unablo  to  do  this  in  tho  traffic  pattern.  For  cxamplo, 
ono  student  summarized  his  problem  by  6aying,  “My  instructor  would 
tell  me  when  wo  were  at  2,500  feet  to  go  down  to  1,000  feet  and,  when 
I  reached  that  elevation,  to  be  over  a  certain  field.  When  I  got  down 
to  1,000  feet  I  was  always  somewhero  a  way  ofT  from  where  I  was 
supposed  to  bo.”  This  seems  to  bo  very  similar  to  tho  visualization 
problem,  although  of  courso  tho  student  might  bo  ablo  to  visunlizo 
tho  flight  path  but  because  of  the  lack  of  skill  in  handling  tho  airplane, 
be  unable  to  follow  out  his  plans. 

15.  Mechanical  flying  (9  percent) .—This  problem  was  frequently 
one  of  using  tho  samo  amount  of  rudder  or  aileron,  regardless  of  tho 
degree  of  bank  or  turn  desired,  or  flying  according  to  verbal  directions 
from  the  instructor  rather  than  by  the  feel  of  the  airplane  or  on  tho 
basis  of  understanding  of  the  airplane’s  behavior. 
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10.  Inadequate  wind-drift  correction  ( 9  percent ).  In  this,  a  student 
wns  unable  to  coordinate  his  degree  of  bank  and  the  amount  of  heading 
change  well  enough  so  that  he  could  compensate  for  the  drift  produced 
by  a  crosswind. 

17.  Poor  acrobatics  (9  percent). — This  was  apparently  an  inability 
to  perform  acrobatics  because  of  deficient  coordination  and  timing. 

SUMMARY  OF  TIIE  DEMANDS  OF  THE  TASK 

A  statement  of  the  psychological  demands  of  the  task  of  learning 
to  fly  is  difficult  because  to  date  no  well-agreed-upon  group  of  function¬ 
ally  independent  traits  with  clearly  defined  boundaries  1ms  been 
isolated  in  the  structure  of  human  personality.  The  terms  identifying 
dcsirablo  characteristics  of  the  student  are  used,  thereforo,  not  as 
names  of  elemental  traits,  but  only  as  descriptive  words. 

Deficiencies  in  Any  Specific  Flying  Skill  May  Have  Multiple  Causation 

It  is  not  usually  possible  to  say  that  a  given  deficiency  in  flying 
skill  is  always  caused  by  some  one  characteristic  of  tho  student.  A 
particular  difficulty  may  bo  caused  by  any  one  or  moro  of  a  number 
of  different  reasons.  For  instnneo,  a  student  who  gets  lost  frequently 
may  not  merely  have  poor  ability  in  orientation.  Ono  student  may 
get  lost  because  i  c  has  poor  ability  to  recognize  landmarks.  Another, 
however,  gets  lost  bccauso  ho  forgets  to  look  around  and  notice  land¬ 
marks;  another,  because  he  is  unable  to  divido  his  attention  and  is  so 
occupied  by  flying  the  airplane  that  ho  does  not  have  timo  to  notice 
landmarks;  another  may  be  distracted  by  airsickness;  another  may  be 
preoccupied  with  family  troubles;  and  still  another  loso  his  orientation 
because  looking  down  at  the  ground  makes  him  feel  nervous,  so  he 
does  not  look  often.  A  given  kind  of  difficulty  may  havo  different 
causes  with  different  students. 

The  Specific  Demands  of  the  Task  of  Learning  To  Fly 

In  tho  task  of  learning  to  fly,  tho  demands  upon  the  student  may 
bo  grouped  under  tho  following  heads:  The  student  had  to  bo  well 
motivated  to  accomplish  this  difficult  task;  ho  had  to  conquer  any 
fears  or  apprehensions  and  to  become  emotionally  adjusted  to  his 
task ;  ho  had  to  be  nb!o  to  divide  his  attention,  or  shift  it  rapidly  among 
a  number  of  different  problems  and  to  keep  track  of  a  number  of 
simultaneous  and  progressive  changes  in  tho  actions  of  tho  plane;  he 
had  to  mako  perceptual  judgments  of  complex  sorts  to  sensations 
from  a  number  of  different  sense  modalities;  ho  hnd  to  havo  good 
muscular  coordination;  and  ho  had  to  havo  good  flying  judgment. 
Tho  following  paragraphs  will  summnrizo  tho  demands  of  tho  task. 

Motimtion  and  emotional  adjustment. — While  most  of  tho  students 
wero  motivated  by  a  genuine  interest  in  flying  and  a  desire  to  aid  tho 


war  effort  aa  well  as  a  dcsiro  to  attain  officer’s  status,  a  fow  liked 
everything  about  being  a  pilot  except  the  flying.  Theso  fow  had 
difficulty  in  learning  to  fly  becauso  it  required  a  high  concentration  of 
interest  and  effort  on  the  part  of  a  student. 

The  problem  of  emotional  adjustment  in  the  face  of  a  fear-producing 
situation  was  an  important  one.  Flying  was  regarded  as  dangerous 
and  involved  a  number  of  fear-producing  situations,  such  as  loss  of 
support,  the  loud  roar  of  the  engine,  and  tho  opportunity  to  look 
down  at  tho  ground  from  a  considerable  hoight.  Thero  wero  also  a 
number  of  other  fears  such  as  fear  of  foiluro  and  fear  of  verbal  punish- 
ment  from  tho  instructor.  These  various  fears  tended  to  produco  ten¬ 
sion  on  the  controls,  inability  to  concentrate  on  tho  task,  and  some¬ 
times  airsickness.  These  fears  were  often  specific  and  did  not  appear 
as  a  general  timidity  factor  in  the  personality.  A  student  might  be 
nervous  and  tense  while  flying  certain  maneuvers  and  quite  unafraid 
in  most  situations  on  the  ground;  another  might  be  nervous  in  social 
situations  but  fearless  in  the  air.  That  nervousness,  tenseness,  and 
apprehension  were  real  problems  for  the  student  was  shown  by  the 
fact  that  more  than  half  of  a  group  of  eliminated  students  who  were 
interviewed  admitted  that  they  had  been  nervous  in  tho  air.  An 
analysis  of  instructors’  comments  on  more  than  a  thousand  eliminated 
students  showed  that  for  more  than  half  of  tho  students,  nervousness 
tensenoss,  or  apprehension  wero  mentioned  by  tho  instructor  who 
recommended  elimination.  Tho  student  had  to  conquer  his  fears  so 
that  he  could  concentrate  on  tho  task  at  hand  and  not  bo  emotionally 
disoiganized. 

Division  oj  attention. — A  student  had  to  be  able  to  keep  track  of  a 
number  of  related  and  interacting  activities  going  on  at  tho  same  time. 
This  was  done  either  by  division  of  attention  or  by  shifting  attention 
rapidly  from  one  aspect  of  flight  to  another.  The  student  had  to  have 
tho  ability  to  remain  calm  when,  as  occasionally  happened,  ho  was  for 
a  brief  space  unablo  to  keep  up  with  a  rush  of  necessary  judgments 
and  corrections  of  tho  airplane’s  course.  Ho  had  to  do  tho  most 
important  corrections  first  and  work  as  rapidly  as  he  could  to  make  all 
of  tho  necessary  decisions. 

The  student  had  to  make  rapid  perceptual  judgments. — In  many  flying 
situations  the  perceptual  demands  were  tho  most  crucial  ones.  This 
was  confirmed  by  tho  validity  of  perceptual  factors  in  classification 
tests,  by  students’  reasons  why  they  were  eliminated,  and  by  instruc¬ 
tors’  comments  on  reasons  for  elimination  of  students,  as  well  as  by 
participant-observer  observations.  The  importance  of  perception  was 
illustrated  by  tho  fact  that  a  student  with  only  a  littlo  flying  timo 
could  perform  quite  difficult  maneuvers  if  the  instructor  told  him  what 
to  do  and  “ talked  him  through”  tho  maneuver. 

The  estimation  of  speed  and  distance  was  one  of  the  most  important 
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pressures  for  smooth,  coordinated  flying.  Theso  airplanes  had  higher 
wing  loadings  and  were  more  susceptiblo  to  stalls  and  spins  when 
flown  at  slower  airspeeds. 

2.  The  required  pilot  procedures  were  more  complex  and  presented 
particularly  difficult  problems  during  takc-ofTs  and  landings.  Combat 
aircraft  also  called  for  a  greater  understanding  of  the  fundamental 
principles  of  aeroequipment,  aerodynamics,  engineering,  and  flight 
procedures. 

3.  The  cockpit  position  of  the  pilot  with  respect  to  the  airplane 
might  be  new,  requiring  different  points  of  visual  reference  in  both 
normal  flight  and  in  the  landing  attitudes. 

Certain  problems  of  transition  were  unique  to  the  fighters  and  to  the 
bomber  aircraft.  These  aro  discussed  in  the  following  two  sections. 

Fighter  Transition. — Combat  fighter  aircraft  were  fast,  complex, 
had  high  wing  loadings,  and  presented  particularly  difficult  problems 
since  there  was  frequently  no  room  in  the  airplano  for  an  instructor. 
This  required  the  student  pilot  to  fly  solo  from  the  very  beginning.  A 
laigc  part  of  the  fighter  transition  training  was  therefore  done  on  the 
ground  and  became  a  problem  of  acquiring  new  knowledge  and  transfer 
of  previously  lenrned  information  to  this  new  situation.  The  now 
fighter  pilot  needed  sufficient  confidence  in  his  ability  to  make  this 
transfer  so  that  after  only  a  few  hours  of  ground  instruction,  ho  could 
climb  in,  take  off,  return  and  land  safely.  This  component  of  self 
assurance,  or  its  opposite,  fear  and  lack  of  confidence,  was-  a  common 
variable  among  new  fighter  transition  students. 

After  the  pilot  became  airborne,  he  experienced  for  tho  first  time 
the  new  flying  characteristics  of  his  fighter  aircraft:  The  strong  G- 
factor  pressing  him  down  into  the  scat  during  turns  and  dive  recoveries 
obscured  tho  normal  cues  of  sustentation;  tho  airplane  was  highly 
maneuverable  and  was  particularly  sensitive  to  control  movements;  it 
had  a  rapid  rato  of  climb,  fast  take-off  and  landing  speed,  and  imposed 
upon  the  pilot  new  stresses  and  strains  inevitable  during  maximum 
performance  flight  maneuvers.  Understanding  tho  fundamental 
principles  of  aerodynamics  and  their  application  to  the  speed,  power, 
and  weight  of  his  new  airplane  was  ono  of  tho  more  important  condi¬ 
tions  determining  tho  speed  of  transition  and  proficiency  level  of  the 
fighter  transition  student. 

FigliUr  pilots  were  frequently  told  that  their  airplano  was  nothing 
moro  than  a  platform  for  firing  guns.  This  wns  to  emphasizo  tho  im¬ 
portance  of  accurate  fixed  gunnery  firing.  Almost  half  tho  timo  in 
fighter  Transition  school  wns  spent  practicing  tho  precise,  coordinated 
flying  necessary  for  accurate  gunnery.  Tho  pilot  wns  his  own  best 
instructor  and  had  to  recognize  his  own  weaknesses  and  apply  the 
appropriate  corrections  on  the  basis  of  previously  lenrned  flying 
techniques  and  information  rclativo  to  air-to-air  and  air-to-ground 
fixed  gunnery  firing. 
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Bomber  Transition. — The  difficult  transition  problem  to  four-engino 
bombers  is  exemplified  by  the  fact  that  nearly  all  of  tho  10  weeks  in 
tho  four-engine  Transition  schools  was  required  to  bring  tho  students 
to  tho  minimum  level  of  pilot  proficiency  required  for  tho  B-17  and 
B-24  airplanes.  Only  introductory  training  could  bo  given  in  tho 
maneuvers  and  uso  of  special  equipment  important  in  combat 
operations. 

The  major  problem  facing  the  multiengino  bomber  pilot  was  tho 
understanding  and  control  of  this  very  complicated  and  heavy  picco 
of  flying  machinery.  The  more  capable  tho  student  was  in  transfer¬ 
ring  his  previously  acquired  information  about  aeroequipment,  aero¬ 
dynamics,  and  engineering,  from  tho  single-  or  two-engino  level  to 
theso  four-engine  bombers,  tho  faster  he  could  attain  proficiency  os  a 
four-engino  bomber  pilot. 

The  actual  control  of  tho  four-engino  plane  in  flight  also  called  for 
a  somewhat  different  technique  by  the  pilot.  It  was  more  a  mechan¬ 
ical  control  rather  than  flying  by  tho  "feel’*  of  tho  piano  os  with 
smaller  aircraft.  Even  under  contact  conditions  tho  four-engino 
bomber  pilot  made  frequent  reference  to  his  instrument  panel  sinco 
the  attitudo  of  tho  piano  was  not  easily  perceived  directly,  and  on  high 
altitude  flights  the  ground  and  horizon  cues  were  frequently  obscured. 
It  took  considerable  physical  stamina  and  strength  to  fly  the  B-24, 
particularly  on  the  long  flights  ordinarily  made  in  largo  bombers. 
It  was  said  that  B-24  Transition  training  was  tho  only  school  where 
tho  students  did  not  gain  weight. 

Fear  of  tho  ship  among  new  students  was  a  persistent  problem  re¬ 
ported  by  four-engine  instructors.  This  was  particularly  truo  in  tho 
earlier  days  of  the  expanded  multiengino  program  when  students  were 
frequently  sent  to  B-17  and  B-24  schools  direct  from  single-cngino 
AT-6  schools.  During  the  latter  port  of  1944  a  preflight  familiariza¬ 
tion  period  of  about  five  weeks  was  given  the  students  during  which 
time  they  flew  as  observers  in  tho  airplanes,  took  ground  school 
courses,  talked  with  other  students  and  instructors  and  in  general 
bccamo  accustomed  to  tho  new  largo  airplano  prior  to  actual  (light 
instruction. 

A  good  deal  of  emphasis  was  given,  on  tho  verbal  level,  to  tho 
pilot’s  rolo  as  "  airplano  commander.”  Sinco  tho  student’s  timo  was 
almost  entirely  taken  with  learning  to  fly  tho  airplano  and  sinco  there 
was  only  ono  member,  tho  crew  chief,  to  command,  littlo  actual  train¬ 
ing  in  command  was  given  at  tho  Transition  level. 

Reconversion  to  Training  Aircrajt. — A  transition  problem  in  roverso 
was  tho  reconversion  of  combat  pilots  to  training  typo  aircraft.  This 
was  primarily  a  relearning  problem  sinco  theso  pilots  hod  frequently 
forgotten,  for  example,  that  it  was  perfectly  safe  to  land  at  tho  slow 
speeds  characteristic  of  tho  lighter  airplanes.  With  their  relatively 
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low-wing  loadings,  many  maneuvers  were  possible  and  safe  in  training 
airplanes  which  would  have  been  considered  emergencies  when  flying 
under  combat  conditions.  In  many  eases  these  returnees  had  never 
been  taught,  as  cadets,  the  maximum  performance  possibilities  of  the 
training  aircraft.  They  required  a  little  confidence  training  before 
they  felt  safe  turning  into  a  dead  engine  or  making  single-cngino  and 
power-off  approaches  and  landings  in  the  two-engine  training  airplanes 
used  in  the  Training  Command. 

On  the  other  hand,  the  combat  pilots  had  to  relearn  tho  fact  that 
these  trainers  were  not  constructed  to  stand  up  under  some  of  the 
oerinl  maneuvers  commonly  used  in  combat  operations.  Further¬ 
more,  they  60on  discovered,  in  tho  Central  Instructors  Schools  for 
example,  that  the  sometimes  uncoordinated  flight  control  of  tho  air- 
piano  permissible  in  combat  was  not  accepted  in  tho  Training  Com¬ 
mand  ns  good  flying  technique.  Tho  returnees  had  to  relearn  tho 
precision  type  of  flying  required  of  all  pilot  instructors. 

The  need  for  careful  training  in  transition  to  lighter  aircraft  soon 
became  nppnrcnt  from  the  high  rate  of  minor  and  serious  accidents 
among  the  returned  combat  pilots  when  flying  training  aircraft  with¬ 
out  extensive,  supervised  retraining. 

Summary  of  Essential  Pilot  Demands 

Intellectual. — Rapid  transition  to  new  type  aircraft,  particularly 
combat  airplanes,  reflected  tho  pilot’s  ability  to  transfer  previously 
learned  information  to  the  larger  and  more  complex  airplanes.  Since 
there  was  usually  no  room  in  tho  airplane  for  an  instructor,  tho  student 
fighter  pilot  had  to  mako  his  own  correct  application  of  his  knowledge 
of  aerodynamics,  acroequipmcnt,  engineering,  and  flight  procedures 
on  his  very  first  flight  in  the  new  airplano.  Tho  tremendously  com¬ 
plex  four-engino  bombers  required  extensive  pilot  knowledge  of  equip¬ 
ment  and  engineering  and  detailed  pilot  procedures.  Tho  theoretical 
expectation  would  bo  that  pilots  who  had  learned  to  fly  with  a  logical 
understanding  of  tho  aerodynamic  principles  involved  would  be 
better  able  to  transfer  to  new  airplanes  than  thoso  who  had  merely 
acquired  perceptual  and  motor  skills  by  rote  learning. 

Motor. — It  required  considerable  strength  and  stamina  to  fly 
multiongino  bombers  and  to  fly  on  long-range  fighter  missions.  New 
airplanes  required  different  motor  techniques  and  physical  control 
for  both  the  precision  flying  and  tho  maximum  performance  maneuvers 
characteristic  of  tactical  airplano  operation. 

Perceptual.—' Transition  training  frequently  required  adjustment  to 
new  perceptual  cues  for  both  tho  fighter  and  tho  bomber  pilot.  The 
fast  take-off  and  landing  speeds,  new  cockpit  position  of  tho  pilot  with 
respect  to  the  airplane,  and  a  more  complex  instrument  panel,  illustrate 
some  of  the  new  perceptual  habits  acquired  in  transition  flying. 

Personality  and  emotional. — Tho  unfamiliar  speed,  power,  size, 
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weight,  and  complexity  of  new  airplanes  frequently  presented  a  mental 
hazard  to  new  students.  Some  students  mado  a  much  moro  rapid 
emotional  adjustment  to  this  mazo  of  new  pilot  skills.  Traits  of 
leadership  and  command  ability  were  emphasized  in  selecting  first 
pilots  for  multicnginc  bombers. 

INSTRUMENT  FLYING 
Description  of  the  Instrument  Area 

The  development  of  objective  measures  of  instrument  flying  skill 
provided  the  opportunity  for  personnel  from  tho  Psychological  Re¬ 
search  Project  (Pilot)  to  observe  many  of  tho  fundamental  pilot  traits 
and  abilities  in  tho  important  specialized  area  of  instrument  flying. 
Tho  specific  research  results  are  presented  in  chapters  8,  0,  and  12; 
the  following  analysis  is  expected  to  servo  as  an  orientation  for  thoso 
chapters. 

Definitions. — Tho  purpose  of  instrument  flying  is  to  enablo  a  pilot 
faced  with  bad  weather  to  fly  safely  through  it  without  tho  benefit  of 
vision  outside  of  his  airplane  and  to  allow  him  to  come  down  through 
tho  clouds,  break  out  of  the  overcast  directly  abovo  tho  field  and  land. 
In  addition  to  his  knowledge  of  weather,  tho  pilot  is  dependent  on  cues 
from  the  instrument  panel  and  the  radio  aids  for  information  which 
allows  him  to  maintain  his  orientation  and  to  plan  his  flight  in  a  safe 
and  efficient  manner. 

Importance. — Reports  from  all  of  tho  air  forces  emphasized  tho  ex¬ 
treme  importance  of  good  instrument  flying  in  combat  operations. 
Tho  tremendous  mobility  of  tho  airplano  as  a  weapon  or  transport  is 
completely  useless  whenover  it  must  bo  grounded  bccauso  of  bad 
weather.  Tho  necessities  of  war  frequently  dictated  that  missions 
fly  through  one  or  moro  weather  fronts  and  possibly  let  down  and  land 
at  a  field  that  was  overcast  by  bad  weather;  tho  development  of  tho 
all-weather  airplano  created  a  demand  for  all-weather  pilots.  When 
the  field  was  overcast  and  largo  numbers  of  airplanes  were  all  returning 
at  onco  from  a  mission,  somo  of  them  running  low  on  gas  and  with 
wounded  aboard,  tho  pilots  who  wero  “stacked”  up  waiting  to  lot 
down  had  to  hold  their  assigned  positions  exactly  and  those  who  wero 
breaking  out  through  the  overcast  could  not  afford  to  fail  to  locato  tho 
field  on  the  first  pas3  and  go  around  again  soveral  times. 

Instrument  training  and  research  will  continuo  to  reccivo  increased 
attention  in  peacetime  since  it  is  through  instrument  flying  that 
aviation  can  progress  against  the  restraining  influences  of  weather, 
poor  visibility,  long  over-water  hops,  and  night  flying.  Commercial 
aviation  has  always  emphasized  instrument  flying  since  it  is  of  primary 
importance  in  maintaining  scheduled  flights.  Tho  instrument  panel 
is  also  used  as  the  major  reference  for  precision  control  of  largo  multi- 
engino  aircraft  whero  tho  pilot  sits  far  forward  and  docs  not  havo 
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direct  view  of  the  wings  as  an  aid  in  controlling  tho  attitude  of  the 
airplano  with  respect  to  tho  horizon. 

Training. — At  the  Basic  school  tho  student  was  taught  to  perform 
under  instrument  conditions  nearly  all  the  maneuvers  ho  had  already 
learned  tinder  normal  contact  conditions:  straight-and-levcl  flight 
including  changing  air  speed,  turns,  climbs  and  glides,  stalls,  recoveries 
from  unusual  positions,  and  emergency  procedures.  In  the  Advanced 
schools  the  student  was  introduced  to  the  use  of  radio  equipment  as  a 
menus  of  performing  cross-country  navigation,  location  of  tho  homo 
radio  station,  and  letting  down  for  landing,  all  under  instrument  con¬ 
ditions.  In  Transition  training  all  previous  instrument  training  was 
reviewed  and  practiced  in  the  new  type  airplano.  Ground  school 
courses  in  weather  and  instrument  flying  and  navigation  paralleled 
instrument  flight  training.  Each  rated  pilot  in  the  Training  Command 
was  required  to  practice  instrument  flying  at  least  three  hours  each 
month  and  to  pass  an  annual  proficiency  check  to  maintain  his  rating 
ns  an  instrument  pilot. 

Analysis  of  Instrument  Flying 

Soino  of  tho  maneuvers  illustrating  tho  more  important  skills  re¬ 
quired  in  successful  instrument  flying  will  bo  described  in  the  following 
purngraplis.  , 

Flight  planning. — This  phaso  illustrates  tho  extensive  and  accurate 
information  required  by  the  instrument  pilot.  First  ho  must  choose 
tho  routo  and  nltitudo  which  will  havo  tho  fewest  hazards  such  as 
mountains  or  icing  conditions,  and  which  will  avoid  the  worst  turbu- 
lenco  and  headwinds,  and  will  bo  facilitated  by  tho  most  dependable 
navigational  aids.  Often  a  number  of  theso  factors  must  bo  balanced 
ono  against  another.  To  do  this  involves  a  wido  knowledge  of 
meteorology,  navigation,  and  tho  potentialities  and  limits  of  his  air¬ 
plano  and  its  equipment.  Tho  development  of  printed  tests  to  get  at 
thoso  aspects  of  this  knowledge  which  can  bo  measured  on  tho  ground 
is  described  in  chapter  12. 

Take-off. — Tho  pilot  must  hold  tho  correct  heading  with  hair-line 
accuracy.  It  is  apparent  that  any  slight  deviation,  if  not  corrected 
immediately,  will  lead  tho  airplano  ofT  tho  runway.  In  training  tho 
pilot  must  perform  all  actions  incidental  to  the  take-oil  under  the 
hood  ami  by  reference  to  instruments  alone.  In  an  actual  instrument 
tnke-oir,  the  pilot  can  usually  nt  least  see  tho  edgo  of  tho  runway. 

As  soon  as  tho  airplane  is  airborne  tho  motor  components  of  flying 
remain  much  the  same,  but  tho  pilot  must  use  and  interpret  a  new 
set  of  cues  in  order  to  know  where  ho  is  going  and  what  is  happening 
to  his  airplane.  Tho  only  source  of  theso  new  cues  is  his  instrument 
panel.  Nearly  all  previous  experiences  of  movement  on  tho  ground 
have  been  in  only  two  dimensions  using  visual  cues  ns  tho  direct  link 
between  himself  and  tho  environment.  Instrument  flying  contradicts 
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these  thoroughly  established  perceptual  habits  and  requires  the  sub* 
stitution  of  a  highly  conceptualized  system  of  control.  Tho  pilot 
must  learn  the  meaning  of  the  instrument  cues  and  substitute  theso 
for  the  more  familiar  ones  in  controlling  tho  movement  of  his  airplano 
in  all  three  dimensions. 

The  following  maneuver  illustrates  how  tho  pilot  makes  this  sub* 
stitution  of  instrument  cues  for  his  own  sensations  of  movement. 

Straight-and-level  course. — The  pilot’s  problem  is  to  hold  a  constant 
altitude,  air  speed,  and  heading.  Since  rather  narrow  limits  of  in* 
strument  deviations  must  be  maintained  this  is  a  difficult  task  for  the 
new  students.  Tho  secret  of  successful  performance  lies  in  careful 
trimming  and  frequent  cross-checking  of  tho  instruments.  Each  in¬ 
strument  has  its  own  special  advantages  and  disadvantages.  Tho 
gyro-  and  magnetic  compasses  tell  him  in  what  direction  ho  is  going 
and  whether  or  not  ho  is  turning.  In  this  function  they  are  supple¬ 
mented  by  tho  ratc-of-turn  indicator.  The  magnetic  compass  has  a 
tendency  to  swing  and  givo  a  false  indication  of  direction  when  the 
plane  is  turning,  climbing,  or  diving.  Tho  gyrocompass  is  not  subject 
to  these  errors  but  has  a  tendency  to  prccess  away  from  its  original 
setting  and  hence  must  be  periodically  checked  against  tho  magnetic 
compass.  The  tum-nnd-bnnk  indicator  tells  him  whether  ho  is  slip¬ 
ping  or  skidding.  The  artificial  horizon  tells  him  at  a  glance  the 
attitude  of  his  airplane;  whether  his  nose  is  high  or  low,  whether  his 
wings  aro  level  or  banked. 

From  tho  preceding  description,  it  should  bo  apparent  that  tho 
pilot  must  keep  constantly  looking  from  one  instrument  to  another, 
cross-checking  them  and  integrating  tho  separate  cues  into  a  complete 
picture  of  what  is  happening  to  his  airplane  at  nny  given  moment. 
In  fact,  motion  picture  studies  of  eye  movements  made  by  the  Navy 
Instrument  School  have  indicated  tlmt  a  good  pilot  makes  ns  many  os 
200  fixations  per  minute  during  precision  instrument  flying. 

Turns. — Students  were  given  a  good  deni  of  practice  making  turns 
to  any  predetermined  heading.  Usually  theso  wero  “standard  rato 
turns”  meaning  3°  of  turn  per  second.  This  rate  was  used  os  a  stand¬ 
ard  because  it  made  timing  of  turns  easier  sinco  3°  per  second  means 
180°  in  one  minute.  It  also  was  used  to  insure  uniformity  in  the  turns 
required  from  nil  pilots  when  making  the  let  down  through  tho  over¬ 
cast  to  complcto  the  final  low  approach  and  landing.  Theso  turns 
required  tho  student  to  cross-check  the  sweep  secondhand  on  tho  clock 
against  tho  gyrocompass  as  well  as  the  ball-bank  indicator.  They 
demanded  the  coordinated  use  of  rudder,  ailerons,  and  elevators. 

Frequently,  the  student  was  required  to  executo  these  turns  without 
tho  use  of  the  gyrocompass  and  the  artificial  horizon.  This  was  dono 
to  insure  the  pilot’s  ability  to  continue  normal  flight  in  enso  theso 
instruments  should  fail  to  operate  correctly  due  to  mechanical  failure 
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or  because  the  plane  had  been  thrown  into  an  extremo  or  unusual 
attitude.  The  remaining  instruments  were  referred  to  as  “partial 
panel"  or  “restricted  panel"  and  included  the  ratc-of-turn  indicator, 
ball-bank,  air  speed,  altimeter,  magnetic  compass,  and  clock. 

Steep  turns  with  an  angle  of  bank  of  40°  or  more  were  also  done 
under  instrument  conditions  though  hero  tho  main  emphasis  w’as  on 
maintaining  a  safe  air  speed,  a  constant  angle  of  bank,  and  a  minimum 
loss  of  altitude  rather  than  on  coming  out  on  a  predetermined  heading. 

Since  it  is  practically  impossible  to  maintain  constant  altitude  with 
a  variable  angle  of  bank,  one  of  tho  more  common  errors  was  in¬ 
adequate  cross  checking  between  the  turn  and  bank  and  the  altimeter. 
Other  common  errors  wero  excessive  use  and  over-control  of  tho 
rudder,  aileron,  and  elevators;  and  inaccurate  anticipation  of  compass 
lag  when  rolling  out  of  tho  turn. 

Unusual  positions. — One  of  the  first  things  an  instrument  pilot  had 
to  learn  was  to  trust  his  instrument  panel  cues  despito  tho  frequent 
conflicting  physical  sensations  erroneously  perceived  while  tho  plane 
was  in  flight.  Unless  the  pilot  kept  a  constant  watch  on  tho  instru¬ 
ment  panel,  a  slight  deviation  in  bank  might  develop  and  not  bo  felt, 
since  it  started  gradually  and  involved  no  change  above  tho  threshold 
for  sensing  acceleration.  This  typo  of  error  could  soon  result  in  a 
tight  diving  spiral  or,  in  the  ense  of  gradual  loss  of  air  speed,  in  a  spin. 
These  were  persistent  mental  hazards  which  could  only  bo  overcome 
after  the  pilot  gained  confidence  in  his  instruments  and  in  his  ability  to 
execute  a  snfc  recovery  from  any  unusual  position  of  tho  aircraft. 

The  aim  of  all  unusual  position  recoveries  was  to  resume  level  flight 
at  a  safe  air  speed  with  a  minimum  loss  of  altitude.  Recoveries  were 
frequently  made  difficult  by  the  extreme  tenseness  of  the  pilot.  Ofton 
a  pilot  would  think  that  he  was  using  all  of  his  strength  to  movo  the 
controls  when  in  effect  lie  was  merely  working  against  himself.  This 
was  particularly  truo  in  tho  uso  of  tho  rudder,  whero  a  pilot’s 
leg  muscles  might  bo  so  tenso  os  to  mako  it  impossible  for  him  to 
exert  enough  pressure  on  one  pedal  to  overcome  tho  pressure  on  tho 
other  pedal.  In  making  these  recoveries  he  had  to  learn  to  disregard 
his  natural  sensations  of  position  because  theso  wero  subject  to 
dangerous  illusions.  For  instance,  if  ho  straightened  out  after  having 
been  in  a  diving  spiral  to  the  left,  he  would  have  the  strong  illusion 
of  (timing  to  the  right,  and  if  ho  followed  the  natural  tendency  to 
correct  for  this,  he  would  go  back  into  a  spiral  again. 

Use  oj  radio  aids  in  flight. — Tho  maneuvers  described  so  far  did  not 
involve  the  use  of  radio  aids  and  wero  first  taught  to  tho  student  at  tho 
Basic  level.  At  the  Advanced  level  tho  student  reviewed  his  “basic” 
maneuvers  and  was  taught  tho  procedures  of  radio  navigation,  rango 
orientation,  let  down  and  low  approach,  and  tho  uso  of  other  special 
equipment  such  as  tho  radio  compass. 

It  was  only  through  the  use  of  radio  aids  that  pilots  wero  ablo  safely 
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to  take  off,  fly  cross-country,  and  let  down  to  land  at  tho  destina¬ 
tion — all  under  instrument  conditions.  The  “basic"  maneuvers  wero 
primarily  a  system  of  training  devices  for  teaching  tho  pilot  tho 
essential  components  of  an  integrated  instrument  flight.  This  rela¬ 
tionship  is  illustrated  in  the  following  maneuver. 

Instrument  let-down  and  low  approach. — Most  of  tho  problems  of 
instrument  flying  were  concentrated  in  tbc  Instrument  Let-Down  and 
Low-Approach  maneuver.  Tho  purpose  of  this  whole  procedure  was 
to  enable  the  pilot  to  let  down  from  his  cruising  altitude  and  to  break 
out  through  the  overcast  at  the  right  spot  in  ordor  to  land. 

Tho  successive  steps  in  tliis  important  maneuver  aro  illustrated 
diagrammatically  in  flguro  3.2  and  aro  briefly  described  in  the  text 
that  follows.  By  rcfcrcnco  to  the  appropriate  tables,  the  pilot  tuned 
in  his  radio  to  the  station  at  his  field  destination.  IIo  then  established 
his  orientation  in  terms  of  tho  radio  signals,  and  flew  to  intersect  ono 
of  the  four  radio  beams.  lie  approached  the  radio  station  by  follow¬ 
ing  this  beam.  If  he  flew  too  far  to  one  sido  he  heard  a  dot-dash  (A); 
on  tho  other  side  a  dash-dot  (N);  when  he  was  in  tho  middlo  of  tho 
beam  these  signals  merged  into  a  constant  tone  signal,  tho  beam.  By 
a  series  of  corrections  lie  bracketed  the  beam  and  found  tho  beading 
which  took  him  straight  down  to  tho  station. 

As  the  plane  approached  the  station,  tho  beam  narrowed  down  and 
tho  pilot  had  to  fly  more  precisely  or  he  would  miss  tho  cono  of  silence. 
When  ho  was  directly  over  tho  station,  ho  “heard"  tho  cono  of  silenco; 
the  signal  built  up  to  a  maximum  intensity,  ceased  for  a  moment  and 
then  resumed.  AH  this  time  tho  pilot  had  been  flying  at  a  prescribed 
altitude.  His  problem  now  was  to  fly  out  along  the  leg  of  tho  beam 
which  was  specified  on  his  Instrument  Let-Down  Procedures,  at  the 
proper  air  speed,  for  the  proper  time,  losing  altitudo  at  a  prescribed 
rate,  mako  a  precision  turn,  and  come  back  so  that  ho  would  hit  tho 
cono  of  silenco  again  at  a  specified  lower  altitude.  Tho  pilot  tlion 
continued  on  down  tho  beam  at  a  constant  prescribed  air  speed,  still 
losing  altitudo  at  tho  proper  rate  so  that  at  a  given  timo  ho  would 
arrivo  at  an  altitudo  of  500  feet  abovo  tho  ground  directly  over  tho  qdgo 
of  tho  field. 

In  addition  to  this  flight  sequence,  tho  pilot  lmd  to  maintain  con¬ 
stant  radio  contact  with  tho  control  tower  by  following  a  standardized 
voico  and  communication  procedure.  Before  tho  piano  readied  tho 
field  tho  pilot  also  had  to  go  through  1:  is  landing  procedures  and 
checks. 

Unless  ho  performed  all  parts  of  tho  maneuver  precisely,  ho  was 
likely  to  como  out  in  tho  wrong  placo  and  bo  unablo  to  sco  tho  field. 
Then  lie  had  to  climb  back  up  according  to  a  prescribed  procedure  aud 
start  all  over  again.  At  best,  this  would  wasto  timo  and  gasolino, 
and  at  worst,  it  might  cause  him  to  run  into  a  mountain  or  somo  other 
obstruction.  If  tho  problem  is  complicated  by  placing  many  other 
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airplanes  in  tho  vicinity  (returning  from  a  combat  mission,  running 
low  on  gas,  anxious  to  land  and  spaced  out  on  the  beam  at  dilTorent 
altitudes  ns  directed  by  tho  control  tower)  tho  need  for  precision 
flying  and  clear  thinking  is  obvious. 

The  execution  of  this  Instrument  Let-Down  and  Low-Approach 
placed  the  pilot  under  marked  tension,  particularly  if  ho  was  not 
familiar  with  this  radio  range,  if  the  radio  signals  were  not  clear  due  to 
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static  interference  or  if  ho  had  not  had  recent  practice  in  performing 
the  maneuver.  Though  the  pilot  was  applying  his  full  power  of 
concentration  to  the  task  at  hand,  a  number  of  disturbing  thoughts 
always  managed  to  creep  in  to  make  him  “sweat."  Flying  at  3  miles 
per  minute,  an  error  of  20  seconds  or  more  could  causo  him  to  miss 
sight  of  the  mile  long  runway.  Failing  to  make  the  correct  adjust¬ 
ment  for  atmospheric  pressure  on  tho  altimeter  could  causo  him  to 
crash  into  oostaclcs. 

All  tho  skills  necessary  in  instrument  flying  had  to  bo  called  upon 
during  this  critical  manuever:  Tho  pilot  had  to  remain  relatively 
calm,  relaxed,  and  clear  headed,  tho  successive  stops  in  tho  procedure 
had  to  bo  followed  in  tho  right  order  and  at  tho  right  timo,  tho  per¬ 
formance  of  each  aspect  had  to  be  done  with  a  high  level  of  precision, 
perception  of  tho  changing  radio  cues  and  tho  instrument  indications 
had  to  be  immediate  and  accurate.  While  no  single  phoso  of  this 
maneuver  was  unusually  diflicult  or  unfamiliar  to  tho  trained  instru¬ 
ment  pilot,  tho  combination  into  a  paced,  rapidly  moving,  complox 
pattern  of  flight,  placed  a  sovero  demand  on  his  over-all  pilot  skill. 

Summary  of  Essential  Psychological  Demands 

The  abovo  description  of  some  aspects  of  instrument  flying  has  been 
aimed  at  emphasizing  somo  of  tho  psychological  factors  important  in 
this  specialized  area.  One  convenient  grouping  suggests  tho  following 
analysis: 

Motor  factor. — Most  movements  of  tho  controls  wero  small  and 
intended  to  keep  tho  plane  within  rather  small  and  precise  limits  of 
deviation.  Actually,  these  movements  were  not  noticeably  different 
from  contact  flying.  Tho  pilot  was  no  longer  flying  with  constant 
reference  to  the  visible  horizon  and  tho  ground  but  could  refer  only 
to  instrument  needles  and  dials  whose  absolute  nmount  of  movement 
was  rather  small  and  with  a  characteristic  lag  between  tho  actual  now 
movement  of  the  plane  and  tho  indication  on  tho  instrument.  Tho 
result  of  these  conditions  was  a  tendency  for  tho  student  to  work  too 
hard  by  using  cxccssivo  and  over-controlled  movements  with  conse¬ 
quent  strain  and  physical  fatigue. 

Perceptual. — Precision  instrument  flying  was  as  much  a  function  of 
accurate  perception  as  it  was  of  coordinated  motor  control.  In  fact, 
the  chief  difference  between  contact  and  instrument  flying  was  tho 
substitution  of  new  perceptual  cues  for  old  familiar  ones.  This,  of 
course,  is  a  difficult  adjustment  in  any  phase  of  human  activity.  Tho 
instrument  pilot  had  to  maintain  a  constant  watch  on  his  instrument 
panel,  continuously  checking  the  readings  of  ono  instrument  against 
ono  or  several  others;  ho  had  to  anticipate  slight  movements  within 
tho  rather  narrow  perceptual  field.  This  task  bceatno  particularly 
difficult  in  rough  air  and  was  nlso  conducive  to  vertigo  and  semi¬ 
hypnotic  effects  during  long  flights  and  at  night. 
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Intellectual. — Instrument  flying  was  a  continuous  sequence  of  plan¬ 
ning  and  following  exact  procedures.  The  importance  of  the  knowledge 
and  information  element  had  been  indicated  in  a  preceding  paragraph 
describing  flight  planning.  Furthermore,  it  was  a  less  direct,  more 
conceptualized,  and  complex  pilot  task  than  contact  flying.  Instru¬ 
ment  instructors  frequently  emphasized  to  their  students  that  instru¬ 
ment  flying  is  simple  if  they  “just  use  their  head.”  While  this  was  a 
frequent  admonishment  in  all  phases  of  flying,  it  appeared  to  be 
especially  appropriate  in  tho  instrument  area. 

The  intellectual  demands  of  the  instrument  pilot  are  substantiated 
by  evidence  from  a  study  conducted  at  Psychological  Research  Unit 
No.  3.  It  wn9  found  that  the  navigator  staninc,  which  has  a  greater 
intellectual  component,  significantly  differentiated  pood  and  poor 
instrument  students,  but  not  good  and  poor  contact  students.  This 
study  was  done  at  the  Basic  level;  the  difference  might  have  been 
even  greater  at  tho  Advanced  schools  where  a  more  complicated  typo 
•of  instrument  flying  was  taught. 

Personality  j actors . — In  contact  flying  the  pilot  had  constant  refer¬ 
ence  to  ground  and  horizon  and  could  alter  his  flying  procedure  at  any 
time.  In  instrument  flying,  however,  tho  pilot  had  less  flexibility 
and  was  committed  to  following  his  course  onco  the  decision  was  made. 
IIo  therefore  had  to  have  sufficient  confidence  in  his  knowledge  and 
ability  ns  an  instrument  pilot  to  follow  this  plan  until  an  error  was 
clearly  indicated.  Instrument  instructors  emphasized  this  trait  in 
describing  good  and  poor  instrument  students.  Added  to  this  con¬ 
dition  was  tho  fact  that  actual  instrument  flying  was  dono  under  ad¬ 
verse  flying  conditions  which  in  themselves  added  stress  to  tho  pilot’s  job. 

NIGHT  FLYING 

Importance 

Round-the-clock  flying  gavo  tho  Air  Forces  much  greater  flexibility 
and  effectiveness  both  in  combat  and  in  routine  flying.  Tho  individual 
pilot  frequently  found  it  necessary  to  fly  at  night  or,  if  delayed  by 
bad  weather,  mechanical  difficulties,  clmngo  of  route,  etc.,  to  complete 
a  planned  daytime  flight  at  night.  Night  flying  like  nighttime  auto¬ 
mobile  driving  was  more  dangerous  than  daytimo  operations  and 
called  for  superior  pilot  skill  and  understanding  of  tho  task.  Night 
flying  training  generally  started  at  tho  Basic  level  and  continued  for 
tho  rest  of  tho  pilot's  flying  career. 

Equipment 

Tho  P-01,  tho  Black  Widow,  was  tho  only  AAF  airplano  specifically 
designed  for  night  flying  operations  but  most  training  and  all  tactical 
type  aircraft  carried  tho  necessary  equipment  for  night  flying  and 
landing.  Navigation  lights  on  tho  wing  tips,  dome,  and  tail  mado  the 
airplane  visible,  runway  lights  pointed  out  tho  landing  runway,  landing 
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lights  on  the  airplane  threw  beams  ahead  and  below,  a  floodlight  at  the 
landing  end  of  the  runway  lit  up  that  area,  cockpit  lights  mado  the 
interior  of  the  airplano  visible  when  desired,  and  fluorescent  lights 
could  bo  turned  on  to  illuminato  tho  dials  on  tho  instrument  panel. 
The  radio  equipment  was  frequently  used,  particularly  during  night 
cross-country  flying  to  maintain  orientation  with  respect  to  tho  differ¬ 
ent  commercial  and  AAF  radio  stations. 

Analysis  of  the  Night  Flying  Task 

Relation  to  instrument  flying. — It  was  only  on  clear  nights  when 
ground  cues  could  be  grouped  into  an  unmistakablo  pattern  and  the 
horizon  was  well  defined,  that  night  flying  was  similar  to  daylight 
contact  flying.  Otherwise,  night  flying  had  to  bo  considered  a  special 
case  of  instrument  flying.  At  night  most  new  pilots  wero  conscious  of 
tho  ever-present  hazard  of  loss  of  orientation  and  soon  learned  to 
depend  on  their  instrument  and  radio  cues  as  navigational  guides. 
Most  of  tho  description  given  in  tho  instrument  flying  section  of  this 
chapter  is,  therefore,  applicable  to  night  flying  operations. 

There  were  a  few  conditions  characteristic  of  night  flying  which 
should  bo  considered  in  addition  to  tho  conventional  instrument 
problems. 

Weather. — Night  flying  in  weather  that  furtlier  reduces  visibility  was 
a  sourco  of  confusion  to  the  pilot.  It  difTcrcd  from  daytimo  weather 
flying  sinco  dangerous  thundercloud  formations  wero  not  readily  dis¬ 
cernible  and  might  bo  entered  unawares.  Tho  student  pilot  had  to 
learn  how  to  recognize  theso  conditions  and  bo  on  tho  alert  for  them. 
Icing  was  another  danger  which  the  student  might  not  observo  at 
night  until  his  margin  of  safety  was  greatly  reduced. 

Perceptual  confusion. — Any  experienced  pilot  can  tell  how  ho  has 
mistaken  a  star  for  a  light  beneath  him  and  how  ho  thought  lights 
were  moving  past  him,  when  actually  he  was  turning  about  tho  lights. 
At  night  a  pilot  could  easily  get  so  confused  that  ho  actunlly  did 
not  know  which  way  was  up,  or  whether  the  aircraft  was  turning, 
diving,  rolling,  or  climbing.  With  a  fow  of  theso  experiences,  the 
pilots  soon  learned  to  uso  tho  instrument  panel  as  tho  major  rcfcrcnco. 

Depth  perception  takes  on  new  properties  in  night  flying.  A 
strong  light  on  tho  ground  will  look  closer  than  a  dim  light  in  tho 
samo  place.  Typical  of  night  landing  hazards  is  that  of  landing  by 
floodlight.  Tho  inexperienced  pilot  is  likely  to  attempt  to  land  on 
tho  beam  of  light  instead  of  on  tho  runway  below'  it. 

The  pilot  must  also  be  on  guard  against  tho  factors  producing  vertigo 
and  a  type  of  semihypnotic  condition  which  aro  not  uncommon  during  . 
night  flying.  Excessive  concentration  on  tho  red  tail  light  of  a  pro- 
ceding  piano  in  a  formation  flight,  tho  effects  of  tho  constant  beam 
signals  in  tho  car,  hyperattention  to  tho  dim  instrument  dials,  aro 
among  tho  possiblo  sources  of  pilot  confusion  which  bccomo  particularly 
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effective  when  the  pilot  is  flying  while  sleepy  or  fatigued  after 
several  hours  in  tho  air. 

Night  vision. — Candidates  for  pilot  training  were  not  screened  on 
the  basis  of  night  vision  tests.  However,  a  training  program  in  night 
vision  was  developed  in  the  Training  Command  involving  a  system  of 
demonstration  and  exposition.  Tho  students  were  instructed  how 
to  adjust  their  eyes  for  night  vision  by  remaining  in  a  dark  room  or 
wearing  red  goggles  and  how  best  to  see  objects  at  night  by  using 
peripheral  vision. 

Since  the  instrument  dials  wero  not  easily  seen  at  night,  a  common 
error  among  students  was  to  increase  their  margin  of  safety,  for 
example,  by  flying  ot  higher  air  speeds. 

The  superior  night  flyer  was  a  pilot  who  understood  tho  special 
conditions  peculiar  to  night  flying  and  how  best  to  protect  himself 
from  these  special  hazards.  The  primary  requisite  was  skill  as  an 
instrument  pilot. 

NAVIGATION 

Introduction 

Cross-country  flying  started  in  Primary  school  and  continued 
through  tho  rema:ndcr  of  training.  The  student  pilot  was  constantly 
reminded  always  to  maintain  his  orientation  during  both  local  and 
cross-country  flights.  Tho  simplest  typo  of  navigation  is  called 
Pilotage  and  refers  to  control  of  tho  flight  by  direct  rofcrenco  to  ground 
markings.  Gradually,  moro  complicated  systems  of  navigation  wero 
introduced  such  ns  Dead  Reckoning;  calculations  in  terms  of  compass 
headings,  and  air  speed,  ground  speed,  etc.  including  corrections  for 
wind,  altitude,  and  compass  deviations,  and  Radio  Navigation.  By 
far  the  most  common  method  used  by  pilots  wns  tho  combination  of 
Pilotage  and  Dead  Reckoning  with  radio  aids  being  used  during  instru¬ 
ment  conditions  and  as  a  doublo  check  on  cross-country  reference 
points. 

Pilot  navigation  in  tho  combat  theaters  was  a  much  moro  specialized 
task  which  utilized  devices  and  new  equipment  not  available  for  Train¬ 
ing  Command  instruction.  No  attempt  is  mado  to  describo  pilot 
navigation  in  tho  overseas  areas. 

Analysis  of  Pilot  Navigation 

Navigation  flights  wero,  to  a  large  extent,  tho  practical  application 
of  systems  and  methods  of  navigation  learned  on  tho  ground.  How¬ 
ever,  there  were  wido  individual  differences  in  tho  ability  of  pilots  to 
apply  this  information  during  actual  flight. 

Planning  the  flight. — Tho  pilot  first  consulted  available  information 
to  determine  tho  courso  and  heading  for  tho  most  efficient  flight  to  his 
destination.  Tho  pilot  had  to  consider  such  variables  ns:  Speed; 
weather;  typo  and  rango  of  tho  airplano  and  tho  navigational  aids 
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available  in  it.  Good  planning  was  dependent  on  tho  pilot’s  briefing 
or  past  cxpcrienco  and  familiarity  with  the  routo  to  bo  followed  but 
these  factors  could  not  compensate  for  a  lack  of  specific  knowledge 
and  information  essential  to  successful  navigation. 

Recognition  oj  check  points. — Sinco  tho  pilot  had  so  many  other 
things  to  do  besides  just  sitting  up  thcro  watching  tho  ground,  it  was 
important  for  him  to  recognize  small,  specific,  identifying  landmarks 
in  a  very  limited  period  of  time.  It  did  not  take  long  for  a  fast  fighter 
airplane  to  pass  over  and  leave  a  small  country  town  but  in  thoso  fow 
seconds  a  good  pilot  navigator  had  to  notico,  for  cxamplo,  the  anglo 
at  which  tho  highway  or  railroad  left  tho  town  and  a  small  creek  and 
tho  bluff  near  the  outskirts  to  tho  north.  Ho  could  then  identify 
theso  features  on  his  sectional  map  and  locato  his  position  with  pin¬ 
point  accuracy.  The  pilot  who  had  to  “buzz”  tho  railroad  station  to 
identify  tho  town  probably  lacked  tho  fast  perceptual  ability  ncccssaiy 
to  rccognizo  ground  cues  and  find  them  on  his  map.  Over  largo  areas 
of  tho  United  States  it  was  difficult  to  become  reoriented  by  reference 
to  b  und  cues  unless  tho  pilot  possessed  very  keen  perception  of  tho 
few  identifying  check-points.  Tho  good  navigator  kopt  a  constant, 
systematic  check  on  his  course. 

Maintaining  a  continuous  check  on  the  pre-established  course. — 
After  correcting  for  magnetic  variation,  tho  compass  heading  and 
estimated  timo  of  arrival  for  tho  successive  legs  of  tho  navigation 
flight  were  established  beforo  take-off.  Somo  cstimato  was  also  made 
for  necessary  wind  correction  though  this  could  not  usually  bo  de¬ 
termined  with  accuracy  until  tho  act  lal  drift  had  been  established 
during  the  flight.  Ground  air-speed  corrections  and  now  power 
settings  also  had  to  bo  mado  during  tho  flight  after  tho  effect  of  the 
wind  had  been  determined  at  tho  altitudo  selected  for  tho  flight.  It 
was  important  that  tho  pilot  hold  his  heading,  altitudo,  and  air-spoed 
doviations  within  as  narrow  limits  as  possiblo,  in  order  to  uso  them  as 
tho  baso  lino  for  his  corrections. 

Facility  in  making  computations. — Tho  speed  of  military  aircraft 
required  rapid  and  accurate  computations  of  heading,  air  speed  and 
rato  of  fuel  consumption  during  flight.  Theso  computations  had  to  bo 
accomplished  in  addition  to  tho  usual  activities  required  to  maintain 
a  safo  and  efficient  flight.  Tho  pilot  had  availablo  sovcral  computing 
devices,  o.  g.,  tho  E-CB  computer,  as  navigational  aids  but  theso  aids 
themselves  required  prcciso  mental  and  motor  application.  It  is 
obvious  that  a  heading  error  of  2  or  3  degrees,  traveling  at  over  200 
m.  p.  h.,  if  not  corrected,  would  soon  lead  tho  pilot  away  from  his 
check-points  and  final  destination. 

Use  oj  radio  aids. — Despito  tho  most  careful  flight  planning,  many 
variablo  factors  such  as  inaccurato  forecast  of  weather  conditions, 
wind  direction  and  velocity,  frequently  introduced  errors  in  tho  pilot’s 
courso.  No  predetermined  compass  heading  could  tbereforo  bo  on- 
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tircly  depondcd  upon  to  bring  tho  pilot  to  his  destination.  The  use  of 
the  radio  rango  was  the  most  common  aid  to  navigation  under  instru¬ 
ment  conditions.  By  tuning  in  on  tho  correct  frequency  tho  pilot 
could  proceed  to  the  desired  station  by  following  tho  beam  emitted  by 
tho  station.  Tho  radio  call  signals  from  different  stations  were  also 
used  ns  intermediate  checks  cn  route.  Recognition  of  tho  identifying 
station  signals,  fading  or  building  of  tho  quadrant  radio  signals  (in¬ 
dicating  approaching  or  leaving  tho  station),  and  recognition  of  the 
cone  of  silence  directly  over  tho  radio  station,  were  constant  auditory 
perceptual  problems  which  had  to  bo  mastered  by  tho  pilot-navigator. 

Summary  of  Esstcntial  Pilot  Demands 
Successful  pilot  navigation  depended  to  a  great  extent  on  such  in¬ 
tellectual  problems  as  flight  planning,  exact  following  of  procedures, 
awareness  of  a  multitudo  of  conditions,  and  judgment  and  decision 
in  the  light  of  variablo  factors  during  tho  flight.  * 

Perceptual  skill  was  also  necessary  when  recognizing  and  interpreting 
tho  ground  check  points  and  tho  radio  cues.  Precise  motor  control  was 
important  to  maintain  the  courso  of  the  airplane  within  narrow  limits 
of  heading,  air  speed,  and  altitude.  Speed  was  an  important  element  in 
all  phases  of  navigation  since  tho  orientation  of  tho  airplano  changes  so 
rapidly.  Abovo  all  tho  pilot  had  to  bo  careful  and  systematic  enough 
to  do  a  lot  of  small  tasks  correctly.  Ho  had  to  resist  tho  temptation 
to  bccomo  careless. 

FORMATION  FLYING 
Definition  of  Formation  Flying 

Formation  flying  refers  to  tho  flight  of  two  or  moro  planes  maneuver¬ 
ing  together  as  a  unit:  Turning,  climbing,  and  flying  straight  and  lovol 
together.  Tho  purpose  of  formation  flying  is  to  combino  tho  oyes, 
firepower,  and  manpower  of  tho  individual  airplanes  in  such  a  manner 
as  to  achiovo  maximum  concentration  of  power  of  attack  and  defense, 
and  control  of  navigation.  When  flying  in  tho  basic  formation,  tho 
pilot  may  bo  in  either  ono  of  two  positions:  Lead  pilot,  with  the 
responsibility  of  planning  tho  flight  in  such  a  manner  that  tho  mission 
is  accomplished  without  endangering  tho  formation  and  minimizing 
tho  task  of  tho  individual  pilots  in  holding  tho  formation;  or  wingman, 
with  tho  task  of  following  tho  lead  piano  in  tho  prescribed  manner. 
The  difficulty  of  this  task  varies  considerably  depending  on  tho  typo 
.  of  formation  and  tho  assigned  position. 

There  aro  a  number  of  different  types  of  flight  formations  depending 
on  tho  mission,  typo  of  plane,  and  flying  conditions,  but  in  all,  tho 
separate  tasks  of  tho  lead  pilot  and  tho  wingmen  remain  essentially  the 
same.  Tiio  following  section  describes  tho  fundamental  problems 
common  to  all  types  of  formation  flying,  from  the  fighters  to  tho  four- 
ongino  bombers.  Somo  typical  formations  aro  illustrated  in  figures 
3.3,  3.4  and  3.5. 
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Fiqure  3.3. — Basie  bombardment  formation  (single  element  "veo") 


Fiona*  3.4.— Basic  fighter  formation. 
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Fiourb  3.5.- 


TypIcaJ  bombardment  group  formation. 
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Analysis  of  Formation  Flying 

The  job  of  the  wingman  in  formation  flying  was  as  pure  a  perceptual- 
motor  tusk  as  could  bo  found  in  any  specialized  area  of  military  avia¬ 
tion.  Tho  wingman  had  to  keep  his  eyes  on  tho  leader  and  follow 
every  movo,  anticipating  him  w’hero  possiblo.  When  flying  at  speeds 
from  160  to  300  m.  p.  h.,  it  did  not  tako  much  of  a  lapso  of  attention  to 
result  in  straggling  or  over-running  and  possiblo  collision.  This  con¬ 
stant  attention  and  physical  adjustment  to  tho  effects  of  rough  air  or 
changing  speeds  and  courso  of  tho  lead  airplane  was  very  fatiguing. 
Wingmcn  did  not  liko  to  fly  with  a  now  leader  whoso  flying  character¬ 
istics  were  unknown  or  abrupt,  making  it  difficult  to  anticipate  new 
movements.  Obviously,  tho  best  leader  was  ono  who  could  fly  a  smooth, 
steady,  consistent  courso,  providing  distinct  signals  when  any  change 
of  positions  was  required. 

Tho  following  word  picture  will  illustrate  the  fundamental  pilot 
skills  required  in  good  formation  flying: 

Tho  problem  of  joining  tho  formation  was  largely  a  matter  of  follow¬ 
ing  established  procedures.  The  timo,  altitude,  and  rendezvous  point 
was  established  beforo  tho  flight.  Tho  specific  pattern  of  tho  forma¬ 
tion  determined  tho  method  of  approach  and  joining.  Onco  in  the 
formation,  tho  wingman  established  his  power  settings  and  trim  adjust¬ 
ments  to  requiro  a  minimum  of  additional  pilot  control  to  maintain 
his  assigned  position.  The  distance  between  airplanes  varied  with 
tho  type  of  formation,  mission,  visibility  and  experience  lovcl  of  the 
pilots  in  tho  group  but  in  most  cases,  tho  goal  was  a  rather  tight  for¬ 
mation  in  which  the  spacing  of  airplanes  would  be  at  a  minimum  of 
one-half  wing  span  distanco  and  at  a  predetermined  level.  Tho  good 
formation  pilot  would  seem  to  “freeze”  right  in  his  nicho  behind  his 
leading  plane  while  a  poor  pilot  was  continually  working,  changing 
throttles  and  moving  the  rudder,  aileron,  and  elevator  controls  to 
help  him  maintain  his  position.  This  cxcessivo  work  resulted  in  an 
accordion  effect  with  a  consequent  waste  of  fuel  and  mndo  tho  task  of 
smooth  flying  difficult  for  all  tho  pilots  in  tho  formation. 

If  the  student  was  not  familiar  with  his  piano,  ho  was  likely  to  make 
errors  in  amount  of  stick,  rudder,  or  throttlo  action  with  tho  resulting 
ragged  formation  and  also  getting  in  tho  way  of  tho  following  air¬ 
planes.  If  tho  student  did  not  make  accurate  and  imnicdiato  per¬ 
ceptions  of  deceleration  and  acceleration  ho  was  likely  to  lag  or  over¬ 
shoot  his  position  and  crowd  up  dangerously  closo  to  tho  leading  air¬ 
plane.  Tho  specific  perceptual-motor  control  varied  with  tho  pilot’a 
position  in  tho  formation;  if  ho  was  on  the  outsido  of  a  turn,  ho  w'ould 
need  to  add  power  and  conversely  tho  pilot  insido  had  to  decrease 
power. 

Changes  of  position  within  tho  formation  called  for  maximum  skill 
in  formation  flying  tcchniquo.  In  tho  first  place,  a  confusion  in 
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interpreting  the  lender's  signal  would  result  in  a  very  serious  jumble 
and  milling  around  by  all  the  airplanes.  When  a  formation  of  nine  or 
more  airplanes  (as  many  as  several  hundred  in  combat  operations) 
started  to  reviso  their  rclntivo  positions,  each  pilot  had  to  be  able  to 
follow  the  exact  procedure  and  reform  in  his  new  position  with  a 
minimum  loss  of  time  and  gasoline. 

For  example,  when  changing  from  the  right-  to  the  left-wing  position 
in  the  B-24,  the  cross-under  and  cross-over  tcchrique  was  frequently 
used.  If  tho  pilot  was  on  the  right,  he  first  lowered  the  nose  of  l^is 
airplane  and  then  reduced  power  to  compensate  for  tho  gain  in  air 
speed  caused  by  the  new  nose-low  attitude.  He  then  skidded  to  the 
left  until  under  his  approximate  ne.w  position  when  ho  immediately  • 
added  power  to  regain  tho  altitude  lost  while  crossing  under.  Com-  | 
mon  errors  were  to  rcduco  power  too  lato  or  too  slowly  thus  crowding 
ahead  of  the  lead  airplane  whilo  crossing  under,  and  bunking  instead 
of  skidding  when  crossing  under  thus  sending  his  airplane  too  far  out 
of  tho  correct  lateral  position. 

The  difficulty  of  performing  all  formation  flying  maneuvers  increased 
with  the  altitude.  At  high  altitude,  tho  airplano  was  sluggish  and 
responded  more  slowly  when  power  was  added.  This  placed  an  oven  j 
greater  premium  on  tho  ability  of  tho  pilot  to  anticipate  every  varia¬ 
tion  from  his  desired  position  since  his  recovery  would  bo  much  more 
difficult  and  slow.  Tho  pilot’s  knowledge  of  tho  aerodynamic  and 
engineering  factors  involved  in  high  altitude  flight  mado  his  task  both 
easier  and  safer. 

Summary  of  Essential  Pilot  Demands 

Except  for  understanding  tho  signals  and  procedures  for  joining, 
leaving,  and  changing  tho  formation,  tho  pilot’s  task  was  primarily 
perceptunl-motor  in  character.  Minimum  throttlo  changes,  smooth, 
coordinated  control  action  and  properly  trimmed  flight  wero  essential 
to  prevent  undue  pilot  fatigue  on  long  flights  as  well  as  to  conserve  fuel  ‘ 
and  maintain  maximum  safety  during  tight  formation  flying.  The 
pilot  had  to  possess  tho  ability  to  maintain  closo  perceptual  attention 
over  long  periods  of  time  and  to  catch  incipient  signs  of  lag  or  accelera¬ 
tion.  Regardless  of  tho  pilot’s  skill,  tight  formation  flying  varied 
considerably  depending  upon  tho  altitude,  consistency  of  tho  lead 
pilot,  mechanical  trim  and  power  of  tho  airplane,  turbulence,  and  ? 

visibility. 

FIXED  GUNNERY 

.  .  c 

► 

The  analysis  of  tho  task  of  fixed  gunnery  is  given  in  chapter  11. 

Students  wero  impressed  with  tho  maxim  that  their  fighter  airplano 
is  nothing  more  than  a  riflo  barrel  with  wings.  Extensive  training 
was  required  before  tho  student  possessed  tho  fino  degreo  of  precise 
coordination  essential  for  accurate  fixed  gunnery. 
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The  pilot’s  task  in  fixed  gunnery  firing  involved  two  major  types  of 
skill:  perceptual  skill  in  evaluating  the  aim;  and  flying  skill  to  cnablo 
the  pilot  to  fly  the  airplane  in  such  a  manner  as  to  obtain  and  keep  tho 
correct  aim  while  flying  a  smoothly  coordinated  course. 

THE  COMBAT  PILOT 

When  tho  pilot  completed  tho  last  phaso  of  instruction  in  the 
Training  Command,  he  was  ready  to  learn  to  become  a  combat  pilot. 
This  was  a  type  of  pilot  specialty  that  could  only  bo  taught  by  units 
in  much  closer  proximity  to  combat  requirements  than  tho  Training 
Command.  Aviation  psychologists  had  tho  opportunity  to  observe 
this  final  and  crucial  phaso  of  training  in  tho  four  continental  air 
forces  and  in  several  combat  air  forces  in  tho  overseas  theaters.  Tho 
analysis  of  the  task  of  the  combat  pilot  is  presented  in  tho  following 
three  reports:  No.  14,  Psychological  Research  on  Problems  of  Redis¬ 
tribution;  No.  16,  Psychological  Research  on  Operational  Training  in 
the  Continental  Air  Forces;  and  No.  17,  Psychological  Research  in  tho 
Theaters  of  War. 
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CHAPTER  FOUR 


The  Problem  of  Measuring 
Flying  Proficiency 

Maj.  Neal  E.  Miller 


FUNCTIONS  OF  FLYING  GRADES 
Selection  and  Elimination 

Ono  of  the  functions  of  measures  of  flying  proficiency  is  to  select 
students  on  tho  basis  of  the  aptitude  which  they  display.  Ono  of  the 
most  important  types  of  selection  is  deciding  which  students  should  bo 
allowed  to  continue  flying  and  which  should  bo  eliminated  for  flying 
deficiency.  Because  flying  training  was  expensive  and  becauso  moro 
than  a  third  of  the  students  who  started  were  eliminated  during  train¬ 
ing,  it  was  important  during  tho  war  to  try  to  discover  and  weed  out 
tho  poor  students  ns  soon  as  possible.  In  addition  to  selecting  tho 
poor  students  for  elimination,  measures  of  proficiency  woro  sometimes 
used  to  select  tho  best  students  for  training  in  certain  specialties  such 
ns  “night  fighter”. 

Whenever  measures  of  proficiency  aro  being  used  to  select  students, 
cither  for  elimination  or  for  somo  special  assignment,  their  function  is 
to  predict  what  tho  student  will  do  in  tho  future.  Thus,  a  high  grado 
at  tho  end  of  Primary  is  a  prediction  that  the  student  will  do  well  in 
Basic  school  and  eventually  in  combat;  a  low  grado  should  mean  that 
ho  will  do  poorly. 

Validation  of  Aptitude  Tests 

Another  function  of  measures  of  proficiency  is  to  dctemiino  tho 
relationship  between  scores  on  pilot  selection  tests  given  before  train¬ 
ing  and  tho  aptitudo  which  students  show  during  flying  training. 
This  function  is,  of  course,  closely  related  to  tho  ono  which  has  just 
been  described.  Any  program  of  aptitudo  testing  is  dependent  at  a 
number  of  crucial  points  upon  tho  accuracy  with  which  subsequent 
performance  can  bo  measured. 

Graduation  on  a  Proficiency  Basis  and  Diagnosis  of  Weaknesses 

A  somewhat  different  function  of  measures  of  proficiency  is  to  de¬ 
termine  how  much  students  hovo  learned  in  order  to  see  whether  or 
not  they  aro  ready  to  movo  on  to  tho  next  stago  of  training.  If  tho 
student  is  being  trained  in  a  number  of  things  at  once,  tho  mensuro 
may  bo  used  to  diagnoso  specific  strengths  and  weaknesses  so  that 
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time  nn<l  ((Tort  may  be  shifted  from  the  strong  areas  to  tho  weak  ones 
whore  it  is  most  needed.  Since  most  aspects  of  flying  training  p'*o* 
coedod  on  a  fixed  schedule  rather  than  a  proficiency  basis,  this  function 
was  much  less  important  in  the  wnrtimo  program  of  flying  training 
than  the  ono  of  selecting  students  for  elimination.  The  instructors, 
however,  did  make  some  use  of  the  daily  and  check-ride  grades  os  a 
basis  for  diagnosing  specific  weaknesses  and  deciding  whero  to  con¬ 
centrate  their  efforts. 

Evaluating  Training  Methods 

Another  function  of  proficiency  measures  is  to  determine  whether 
students  (rained  one  way  arc  better  than  those  trained  in  another. 
Since  there  was  not  time  for  many  training  experiments,  this  function 
was  not  emphasized  during  the  war.  Any  improvement  in  the  means 
of  measuring  the  results  of  experiments  is  a  fundamental  contribution 
to  training  research. 

It  can  be  seen  that  the  first  two  uses  of  proficiency  measures  involvo 
aptitude  while  the  second  two  involve  learning.  To  the  extent  that 
the  students  with  more  aptitude  learn  more  rapidly,  theso  two  types 
of  functions  are  basically  similar;  to  the  extent  that  some  students 
may  catch  on  slowly  at  first  but  eventually  reach  a  high  level  of  per¬ 
formance,  theso  two  types  of  functions  are  basically  different. 

DIFFERENT  TECHNIQUES  OF  MEASUREMENT 

The  techniques  of  measuring  flying  proficiency  may  be  divided  into 
two  main  categories:  Subjcctivo  and  objective.  Tho  subjective 
category  mny  be  sub-divided  into  general  subjective  evaluation  and 
the  rated  work-sample  technique,  and  the  objective  entegory  into 
objective  observation  and  mechanical  recording.  Tho  divisions  be¬ 
tween  these  categories  aro  not  absolute;  there  nro  cases  in  which  ono 
shades  off  into  the  other.  Each  of  tho  different  methods  will  now  bo 
discussed  in  more  detail. 

Subjective  Evaluation 

(hfitral  Subjective  Evaluation. — In  this  technique,  the  student  is 
given  an  over-all  rating  on  some  relatively  broad  quality  such  as 
"general  pilot  ability.”  This  is  the  typo  of  grading  system  which 
was  in  the  most  common  use  in  tho  Training  Command.  The  cate¬ 
gories  were  A,  B,  C,  D,  E,  or  F.  An  attempt  was  made  to  anchor 
these  categories  by'  means  of  descriptions  such  ns  the  following  one  for 
tho  grade  of  D  which  is  given  from  an  instructor’s  manual  for 
Primary  Schools: 

This  student  Is  slow  to  take  Instruction.  You  find  that  you  must  constantly 
repeat  yourself,  but  he  finally  gels  it.  HU  progress  Is  characterized  by  inconsistency. 
You  find  yourself  wondering  how  to  make  him  understand.  “How  am  I  going  to 
get  thU  acroM?” 
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Briefly,  he  hits  faults  of  sound  judgment,  but  faults  that  you  believe  arc  cor¬ 
rectable — not  likely  to  be  habitual  or  dangerous.  His  attitude  must  still  be  good. 
Any  habitual  indifference  calls  automatically  for  an  K  or  V,  His  progrett, 
though  slow  must  still  l>c  fairly  sure.  His  technique  is  not  good— but  not  danger¬ 
ously  bad. 

Another  of  the  wa3’s  to  defino  such  categories  is  tho  perccntilo  or 
normal  curve  system,  in  which,  for  example,  tho  upper  10  percent  is 
given  A,  the  next  20  percent  B,  tho  niiddlo  40  percent  C,  etc.  This 
was  not  used  in  the  Training  Command. 

Retied  Work-Sample. — In  this  technique,  tho  performance  is  frac¬ 
tionated  into  a  scries  of  aspects  on  part  tasks,  each  of  which  is  given  a 
subjective  rating.  Tho  tasks  which  tho  rater  should  observo  aro 
clearly  specified.  For  example,  the  student  may  bo  rated  Excellent, 
Good,  Fair,  or  1,  2,  3,  4  on  a  specific  item  such  as  tho  use  of  throttlo  to 
cheek  approaching  stall  in  slow  flying.  The  ratings  may  bo  relatively 
undefined  or  an  attempt  n  ay  bo  made  to  anchor  them  to  specific 
descriptions.  Tho  rated  work  sample  may  take  tho  form  of  a  check¬ 
list  in  which  a  number  of  different  aspects  of  performance  aro  rated 
on  a  two-point,  or  yes-no  scale. 

The  rated  work  sample  has  the  advantage  of  increasing  tho  likeli¬ 
hood  that  all  students  will  be  measured  on  tho  samo  tasks  and  of 
specifying  the  aspects  of  each  task  which  should  bo  measured.  Somo 
research  from  the  Royal  Air  Force  illustrates  the  typo  of  variability 
which  can  occur  when  the  task  is  not  specified.  Tho  Empiro  Central 
Flying  School  had  30  flying  instructors  give  chock  rides  to  students. 
They  found  that  theso  30  instructors  used  25  different  exercises,  8 
or  9  per  instructor,  and  made  240  different  comments  in  evaluating 
their  students.  As  a  result,  they  embarked  on  a  program  of  standard¬ 
izing  the  maneuvers  which  should  bo  used  in  a  check  ride,  tho  nspecta 
of  these  maneuvers  which  should  be  observed,  and  tho  way  in  which 
they  should  be  rated.  In  this  way  they  produced  a  rated  work-samplo 
type  of  check  ride. 

In  addition  to  specifying  what  should  be  observed,  tho  rated  work- 
sample  method  may  involve  assigning  tho  relative  weights  to  bo  given 
to  performance  on  each  part  of  tho  task.  The  total  seoro  is  then  an 
objcctivo  addition  of  tho  weights  given  to  tho  various  subjcctivo 
ratings  rather  than  an  over-all  subjective  combination.  In  tho  best 
scales  of  this  kind,  the  aspects  of  behavior  which  aro  to  be  rated  and 
tho  relativo  weights  to  be  given  each  of  them  aro  determined  empiri¬ 
cally  on  the  basis  of  validation  experiments. 

Tho  British,  Canadians,  and  Australians  devoted  considcrablo 
effort  to  refining  this  method  of  grading  flying  skill.  They  found, 
however,  that  even  with  this  kind  of  senlo  it  was  necessary  to  give  tho 
check  riders  extensive  truining  in  order  to  get  them  to  agree  on  com¬ 
mon  standards.  Refresher  courses  wero  necessary  in  order  to  main¬ 
tain  agreement.  Bccauso  agreement  was  produced  by  having  tho 
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different  members  of  the  group  compare  their  grades  with  each  other, 
instead  of  by  comparing  their  grades  with  a  permanent  independent 
standard,  there  was  no  guarantee  that  the  standards  of  the  group  a3  a 
whole  may  not  have  gradually  crept  up  or  down  over  a  period  of  time. 
Furthermore,  the  standard  agreed  upon  was  not  described  so  that  it 
could  be  understood  and  interpreted  by  anyono  who  had  not  taken 
the  special  training. 

Objective  Measurement 

In  objective  measurement  absolute  (in  addition  to  relative)  agree¬ 
ment  among  observers  is  achieved  by  using  a  permanent  independent 
standard.  Instead  of  using  subjective  standards  such  as  “poor”  or 
"too  slow"  which  arc  dependent  upon  tho  individual  making  tho 
judgment,  the  performance  is  defined  in  terms  of  a  permanent  standard 
such  as  a  reference  point  on  the  plane  or  an  instrument  rending,  which 
is  relatively  independent  of  the  specific  observer.  This  makes  it 
possible  for  the  results  to  he  mterpreted  in  the  same  way  by  everyono. 
Tho  instrument  chock  specified  in  AAF  Regulation  50-3  represents 
an  important  step  toward  objectivity.  It  suggests  certain  limits  of 
heading,  airspeed,  and  altitude  which  tho  candidate  should  be  ablo  to 
maintain. 

A  convenient  way  of  determining  how  well  absoluto  agreement  has 
been  achieved  is  to  have  two  or  more  independent  judges  uso  tho 
measure  to  make  observations  of  the  same  thing  at  tho  sar.o  time. 
In  doing  this,  a  distinction  must  be  nmdo  between  two  types  of  agree¬ 
ment:  Relative  and  absoluto  agreement.  In  relative  agreement  tho 
two  judges  place  the  individuals  measured  in  tho  same  rank-order; 
they  agree  on  who  is  at  the  top  and  the  bottom  of  tho  class  but  may 
not  agree  on  whether  the  bottom  student  should  bo  given  an  “E" 
or  an  “F."  In  absolute  agreement,  tho  two  judges  agreo  on  the  grades 
to  he  given  to  each  individual  and,  of  courso,  this  means  that  tho 
rank-orders  aro  the  same. 

Tho  difference  between  absolute  and  relativo  agreement  assumes 
special  importance  whenever  different  students  aro  graded  by 
different  observers.  *'f  the  check-riders  from  different  squadrons 
or  schools  wore  aske  d  to  grade  the  samo  group  of  pupils,  they  might 
agree  fairly  well  on  who  should  bo  at  tho  top  and  bottom  of  tho  class 
but  not  on  tho  absolute  trades  to  bo  given  to  theso  students.  When 
these  chock-riders  aro  dealing  with  different  sets  of  students,  tho  ones 
who  are  fortunato  enough  to  get  tho  check-rider  who  has  lower  abso¬ 
lute  standards  aro  more  likely  to  get  a  high  grado  and  thus  will  havo  a 
better  standing  in  tho  ranking  of  tho  combined  group  than  thoso  who 
happen  to  ho  checked  by  a  pilot  with  higher  standards.  To  tho 
extent  that  absoluto  agreement  can  bo  achieved,  it  will  tend  to  pro¬ 
vent  wasteful  differences  among  tho  elimination  rates  of  various 
schools. 
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In  testing  for  absolute  agreement,  it  should  tie  noted  that  if  all  of 
the  students  in  any  experiment  arc  observed  by  the  same  two  judges, 
a  high  correlation  between  these  two  judges  will  by  itself  mean  only 
that  relative  agreement  has  been  established.  In  order  to  establish 
absolute  agreement  it  will  be  necessary  to  show  also  that  the  average 
of  the  grades  assigned  by  the  two  judges  and  the  range  (or  standard 
deviation)  of  these  grades  are  the  same.  When  the  results  of  a  num¬ 
ber  of  judges  paired  at  random  are  combined,  so  that  some  students 
are  measured  by  one  pair  of  judges  and  others  are  measured  by  a 
different  pair,  variation  in  standards  ,vill  reduce  the  correlation. 
Thus,  if  observations  of  a  number  of  judges  paired  at  random  linvo 
been  combined  on  the  same  scatter  diagram,  a  high  correlation  indi¬ 
cates  absolute  as  well  as  relative  agreement. 

The  two  main  types  of  objective  measurement  will  now  bo  discussed. 

Objective  Observation. — In  this  typo  of  measurement  tlio  cheek 
pilot  makes  an  objective  observation,  such  as  the  number  of  feet 
altitude  lost  in  a  turn  or  whether  or  not  the  cnbanc  strut  is  parallel 
to  the  horizon,  and  then  records  bis  observation  by  some  method  such 
ns  writing  it  down  or  making  a  check  mark  on  a  printed  facsimilo  of 
the  instrument  dial.  The  advantage  of  this  method  is  that  it  can  bo 
used  with  the  equipment  available  on  the  average  army  airplane.  Tho 
disadvantage  is  that  the  phenomenon  observed  is  transitory  and  tho 
cheek-rider  must  “retell  it  on  the  fly"  the  first  time  or  lose  it  forever. 

Mechanical  or  Photographic  Recording. — This  method  has  tho  ad¬ 
vantage  of  producing  a  permanent  or  semipermanent  rceord.  De¬ 
vices  such  ns  the  work-adder  and  slip-skid  recorder,  which  will  bo 
descril  cd  later,  add  up  the  student’s  errors  during  a  given  period  of 
time  so  that  they  can  be  read  from  a  dial  which  remains  stationary  at 
the  end  of  the  period  of  recording.  These  are  semipermanent  methods. 
They  place  much  less  of  a  strain  on  the  check  pilot,  who  can  make  bis 
readings  at  leisure,  observing  one  reading  at  a  time  and  cheeking  it, 
after  the  maneuver  has  been  performed.  Photographs  of  tho  instru¬ 
ment  panel  arc  an  example  of  permanent  recording.  It  is  possiblo  to 
grade  recorded  data  subjectively,  as  the  Committee  on  the  Selection 
and  Training  of  Aircraft  Pilots  did  in  having  n  number  of  observers 
evaluate  motion  picture  records  of  a  flight.  Recorded  data  are,  how¬ 
ever,  especially  adapted  to  objective  scoring. 

Necessary  Conditions  for  Good  Measurement 

Task  Clearly  Defined  to  Student. — The  student  must  be  told  how  tho 
various  measures  of  a  given  maneuver  will  be  scored  and  weighted. 
This  is  necessary  because  flying  is  a  complex  task  in  which  the  student 
enn  improve  one  aspect  of  iiis  performance  at  the  oxpenso  of  another 
by  shifting  his  attention.  He  must  be  told,  for  example,  the  relativo 
penalties  for  a  5°  deviation  of  heading  and  a  50-foot  one  in  ultitude. 
If  the  task  is  not  clearly  defined,  two  students  with  the  same  ability 
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mny  get  different  scores  because  they  have  different  opinions  concern¬ 
ing  wlmt  they  arc  supposed  to  do. 

One  solution  to  this  problem  is  to  devise  situations  in  which  tho 
application  of  a  number  of  complex  skills  produces  a  simple,  singlo 
result.  Fixed  gunnery  (described  in  chapter  11)  is  a  good  cxamplo; 
tho  student  uses  all  of  his  flying  skill  to  achicvo  one  singlo  result: 
hitting  the  target. 

Administration  Under  Standard  Conditions. — Unless  all  students 
are  measured  under  standard  conditions,  the  scores  will  measure  tho 
difficulty  of  these  conditions  as  well  as  tho  skill  of  tho  student.  Dif¬ 
ferences  in  the  conditions  of  testing  arc  an  especially  important  sourco 
of  eiror  in  attempting  to  measure  flying  skill. 

One  of  the  sources  of  difficulty  is  the  fact  that  airplanes  nro  much 
more  complex  and  difficult  to  standardize  than  the  average  laboratory 
apparatus  tost.  Cars  of  the  same  year  and  model  may  perform  dif¬ 
ferently,  especially  if  they  have  been  subject  to  various  amounts  of 
use.  Similarly,  airplane  engines  come  out  of  tho  factories  in  some¬ 
what  different  condition  and  change  considerably  as  they  rcccivo 
different  amounts  of.'  wear.  Furthermore,  the  flying  characteristics 
of  the  airplane  arc  influenced  by  a  host  of  other  factors,  such  ns  tho 
rigging,  tho  weight  of  gnsolino  in  tho  tanks,  etc.  It  is  difficult  to 
standardize  all  the  characteristics  of  a  piece  of  machinery  as  com¬ 
plicated  ns  an  airplane. 

The  fact  that  the  skies  arc  not  a  very  stablo  laboratory  in  which  to 
conduct  measurements  is  another  important  source  of  difficulty.  Tho 
velocity,  gustiness,  and  direction  of  the  wind  change  from  day  to  day, 
season  to  season,  and  place  to  plnco.  Similar  changes  occur  in 
visibility,  turbulence,  and  even  in  the  density  of  tho  air.  These 
factors  exert  a  considerable  influence  upon  tho  performance  of  tho 
student.  It  is  difficult  to  measure  and  specify  all  of  them.  Tho 
Pilot  Project  encountered  at  least  as  much  difficulty  in  dealing  with 
tho  effects  of  different  conditions  of  test  administration  os  it  did  in 
achieving  absolute  agreement  between  observers  measuring  the  samo 
thing  at  tho  samo  timo. 

Tho  problem  is  to  increaso  the  ratio  of  tho  effects  produced  by 
differences  among  students  to  those  produced  by  differences  among 
uncontrolled  conditions.  One  way  of  doing  this  is  to  devise  situations 
which  magnify  individual  differences.  It  is  sometimes  possiblo  (for 
example,  in  the  rudder  exerciso  stall  to  be  described  in  chapter  G)  to 
make  the  task  so  difficult  that  tho  performance  of  tho  poor  student 
differs  greatly  from  that  of  the  good  one.  Another  method  has  been  to 
attempt  to  devise  measures  which  are  less  sensitive  to  tho  effects  of 
disturbing  factors.  For  instance,  maintaining  that  air  speed  which 
is  most  efficient  for  climbing  is  less  influenced  by  up-  and  down- 
drafts  than  is  the  nctunl  amount  of  altitude  gained  per  unit  timo. 
Still  another  approach  is  to  standardize  planes  and  instruments  and 
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only  administer  check  rides  under  ideal  conditions  of  wind,  turbulence, 
visibility,  etc.  Sometimes,  especially  in  instrument  check  rides,  it  is 
possible  to  go  to  an  altitude  at  which  the  effects  of  turbulence  aro 
minimized.  For  many  other  types  of  measurement  the  standardiza¬ 
tion  of  all  important  conditions  is  extremely  difficult  in  a  largc-scalo 
training  program. 

A  different  approach  is  to  repeat  the  measures  under  different  con¬ 
ditions  so  that  the  variable  errors  produced  by  them  will  be  balanced 
out  and  the  constant  factor  of  student  skill  will  emergo  from  tho 
average.  The  student  can  be  given  a  number  of  different  check  rides, 
or  an  objective  measure  may  be  repeated  ns  a  part  of  tho  daily  grading 
system  throughout  a  given  phnso  of  training.  It  should  bo  noted, 
however,  that  replication  will  not  get  rid  of  tho  constant  errors  intro¬ 
duced  by  the  fact  that  conditions  such  as  turbulence  may  be  generally 
worse  in  some  sections  of  tho  country  or  during  certain  seasons  of  tho 
year.  The  work  on  fixed  gunnery  described  in  chapter  11  shows  that 
it  is  difficult  to  deviso  formulae  to  correct  for  such  factors.  Theso 
constant  differences  in  tho  conditions  will  produco  tho  samo  effect  aa 
would  a  difference  in  the  absolute  standards  of  tho  observers. 

ATTRIBUTES  OF  A  GOOD  MEASURE 
Permanence  and  Reliability 

If  a  quality  is  extremely  transient,  it  is  usually  not  important  to 
mensure  it.  A  transient  characteristic  cannot  predict  futuro  success. 
The  permanence  of  a  characteristic  can  be  measured  by  repeating  tho 
test  after  a  period  of  time.  If  tho  characteristic  is  in  the  process  of 
being  learned  through  a  course  of  training,  it  is  not  nccessnry  that  *:'o 
student  remain  at  the  same  absolute  level;  it  is  only  necessary  that  ho 
maintain  approximately  the  same  rank  order  relative  to  other  students 
who  arc  going  through  the  same  course  of  training.  If  tho  test  and 
retest  arc  given  by  different  observers  in  different  airplanes,  a  good 
correlation  between  them  indicates  not  only  that  the  measure  has  a 
certain  degree  of  permanence,  but  also  that  there  is  reasonably  good 
agreement  between  tho  two  observers  and  that  changes  in  conditions 
do  not  unduly  influence  it.  The  longer  the  interval  between  the  test 
and  retest,  the  moro  severe  is  tho  test  of  pcnnanenco  and  reliability. 

Relevance 

It  may  be  possible  to  measure  a  relatively  permanent  characteristic 
of  the  individual  which,  however,  is  irrelevant.  Three  methods  havo 
been  employed  to  tc3t  the  relcvanco  of  tho  measures  developed  by  tho 
Pilot  Project: 

Professional  Judgment  oj  Experts. — Beforo  measures  wero  subjected 
to  further  tests,  they  wero  criticized  by  expert  pilots.  Only  thoso 
considered  to  measuro  qualities  relevant  to  tho  task  of  tho  combat 
pilot  were  saved  for  further  work.  In  developing  the  printed  tests  of 
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Hying  information  which  nre  described  in  chapter  12,  it  was  not  possi¬ 
ble  to  get  any  further  criterion  of  combat  relevance.  It  was  necessary 
to  use  items  which  had  been  experimentally  demonstrated  to  givo 
reliable  measures  of  types  of  information  which  experts  returning  from 
combat  believed  were  important.  Though  this  procedure  is  not 
nearly  as  safe  as  validation,  it  has  definite  practical  value  when  suitable 
criterion  groups  nre  not  available. 

Validation  Against  Groups  Differing  in  Flying  Ability. — In  this 
procedure  each  measure  was  tested  for  its  ability  to  discriminate 
bet  ween  students  who  showed  different  amounts  of  skill  at  the  end  of 
the  same  amount  of  Hying  training.  In  somo  studies,  the  measures 
were  correlated  with  flying  grades.  In  other  studies,  extreme  groups 
composed  of  the  best  and  poorest  students  in  a  class  were  selected  on 
the  basis  of  grades  or  by  having  each  instructor  rank  his  students. 
The  check  rides  were  given  only  to  the  students  in  these  extremo 
groups  and  the  ability  of  each  measure  to  differentiate  between  these 
two  groups  was  determined.  The  advantage  of  this  method  lay  in 
the  fact  that  even  though  the  grading  system  had  low  reliability,  there 
was  likely  to  be  little  overlapping  between  the  truo  abilities  of  the 
extreme  groups.  The  final  method  was  to  determine  the  ability  of 
each  measure  to  predict  which  student  would  subsequently  bo  elimi¬ 
nated  for  Hying  deficiency.  This  method  yielded  a  rigorous  test  of 
both  the  permanence  and  the  relevance  of  tho  measure.  All  threo  of 
the  methods  were  based  upon  tho  samo  reasonable  assumption: 
namely,  that  tho  system  of  grading  which  was  in  common  uso  dealt 
with  relevant  aspects  of  Hying  skill  and  needed  improvement  only  in 
its  reliability  and  standardization. 

Validation  Against  Groups  Differing  In  Amounts  of  Flying  Train¬ 
ing. — In  this  procedure  a  test  was  made  of  the  ability  of  a  measure  to 
discriminate  between  two  groups  of  students  who  had  tho  samo  apti- 
tudo  but  differed  in  the  number  of  hours  of  flying  training  received. 
An  alternative  procedure  was  to  compare  measurements  on  tho  samo 
group  during  earlier  and  later  stages  of  its  training.  This  procedure 
was  based  on  the  reasonable  assumption  that  tho  curriculum  taught 
the  students  relevant  types  of  flying  skill  so  that  tho  measures  which 
discriminated  best  between  the  two  groups  with  different  amounts  of 
training  were  tho  most  relevant. 

In  using  this  criterion  tho  investigators  kept  in  mind  the  fact  that 
somo  items  of  achievement  might  bo  so  specific  and  cosily  learned  that 
the  student’s  performance  would  bo  determined  nlmost  entirely  by  tho 
sequence  in  which  these  items  were  taught  in  tho  particular  curriculum 
to  which  ho  was  exposed.  (To  givo  an  extreme  example,  it  might  bo 
possible  to  secure  a  perfect  discrimination  between  two  groups  by 
teaching  only  one  of  them  to  understand  an  unusual  technical  term.) 
Such  nonpower  typo  of  items  would  bo  expected  to  bo  unstablo  and 
transient.  An  attempt  was  made  to  distinguish  them  from  tho  items, 

80 


measuring  more  fundamental  nml  slowly  acquired  types  of  achieve¬ 
ment,  which  represented  milestones  on  the  course  of  learning;.  Wher¬ 
ever  two  groups  with  different  amounts  of  flying  training  wero  used  to 
validate  measures  of  flying  skill,  the  investigators  from  tho  Pilot 
Project  made  certain  that  the  less-experienced  group  had  a  good  clmnco 
to  become  fumiliar  with  the  maneuver  to  bo  measured.  The  assumption 
was  that,  if  tho  less-experienced  group  had  already  hud  a  clmnco  to 
pick  up  all  the  quickly  acquired  aspects  of  performance,  the  superiority 
of  tho  more  experienced  group  would  necessarily  bo  limited  to  thoso 
more  fundamental  skills  tho  gradual  acquisition  of  which  is  an  im¬ 
portant  feature  of  learning. 

It  will  be  noted  that  tho  two  experimental  pioccdures  just  described 
test  for  different  kinds  of  relevance:  The  first  procedure  tests  ability 
to  discriminate  differences  in  aptitude;  the  second,  ability  to  dis¬ 
criminate  differences  in  learning.  If  the  students  with  tho  samo  ex¬ 
perience  but  less  aptitudo  make  tho  same  types  of  errors  ns  thoso  with 
normal  aptitude  but  less  experience,  the  two  procedures  will  bo  equiva¬ 
lent.  To  the  extent  that  students  with  low  aptitudo  and  students 
who  arc  inexperienced  characteristically  mako  different  kinds  of 
errors,  the  two  methods  will  not  be  equivalent  and  it  will  bo  desirablo 
to  select  two  somewhat  different  arrays  of  measures  for  tho  two  differ¬ 
ent  uses.  Measures  selected  by  tho  first  proccduro  will  bo  most 
relevant  in  deciding  which  students  should  bo  eliminated  and  in 
validating  aptitudo  tests;  thoso  selected  by  tho  second  will  bo  most 
useful  in  graduating  students  on  a  proficiency  basis,  diagnosing  tlioir 
strengths  and  weaknesses,  and  in  evaluating  tho  results  of  training 
experiments. 

Comprehensiveness 

Measures  may  be  relevant,  but  still  partly  inadequate  bccauso  thoy 
cover  only  a  few  of  the  important  factors  involved  in  flying  skill.  If 
a  suitable  over-all  criterion  is  available,  it  is  possible  to  determino  tho 
comprehensiveness  of  a  given  set  of  measures  by  seeing  how  well  tho 
combined  score  of  all  of  the  measures  is  able  to  predict  the  criterion. 
Sinco  part  of  tho  failuro  to  predict  perfectly  may  bo  duo  to  tho  un¬ 
reliability  of  the  criterion  rather  than  to  ft  lack  of  comprehensiveness 
of  tho  group  of  measures  being  tested,  it  is  necessary  to  lmvo  somo 
independent  way  of  evaluating  tho  reliability  of  tho  criterion.  If  tho 
reliability  of  the  criterion  is  known,  it  is  possible  to  uso  tho  formula 
for  correction  for  attenuation  to  cstimato  how’  w’cll  tho  measures  would 
predict  a  perfectly  reliable  criterion. u  When  no  comprehensive 
criterion  is  available  and  ono  is  relying  upon  expert  judgment,  it  is 
especially  important  to  examine  the  comprehensiveness  of  tho  group 
of  measures  to  bo  used. 

**  Sco  Guilford,  J.  P.,  PtyckornttrU  Mtihodt,  McOraw  Hill  Book  Co.,  New  York  and  London,  IWfl^ 
p.  307,  formula  IM. 
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If  tho  measures  arc  going  to  bo  routinely  used  to  evaluate  tho 
results  of  training,  the  instructors  will  tend  to  modify  their  teaching 
in  such  a  way  as  to  train  their  students  to  get  tho  best  grades  on  theso 
measures.  Any  continued  use  of  a  system  of  testing  is  bound  to 
exert  a  certain  amount  of  influence  on  tho  curriculum.  If  tho  system 
of  testing  is  one-sided,  the  curriculum  will  bo  distorted;  if  tho  measures 
aro  sufficiently  comprehensive,  they  will  tend  to  keep  tho  curriculum 
properly  balanced.  For  this  reason  particular  attention  was  paid  to 
tho  comprehensiveness  of  tho  measures  developed  by  tho  Pilot  Project. 

Specificity 

Although  tho  battery  of  measures  should  bo  comprehensive,  it  is 
dcsirablo  to  havo  tho  individual  items  specific  so  that  they  can  bo 
used  to  diagnoso  tho  student’s  strengths  and  weaknesses  and  os 
differential  criteria  for  validating  aptitudo  tests.  Ono  of  tho  defects 
of  subjcctivo  measures  is  their  susceptibility  to  “halo  effect.”  Tho 
rater  is  likely  to  be  influenced  by  his  general  impression  so  that  ho 
tends  to  ignoro  tho  good  points  of  poor  students  and  tho  weak  points 
of  good  onos. 
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measuring  more  fundamental  and  slowly  acquired  types  of  achieve¬ 
ment,  which  represented  milestones  on  tho  course  of  learning.  Wher¬ 
ever  two  groups  with  different  amounts  of  flying  training  wero  used  to 
validate  measures  of  flying  skill,  the  investigators  from  tho  Pilot 
Project  made  certain  that  the  less-experienced  group  had  a  good  chanco 
to  become  familiar  with  the  maneuver  to  bo  measured.  Tho  assumption 
was  that,  if  the  less-experienced  group  had  already  had  a  chanco  to 
pick  up  all  the  quickly  acquired  aspects  of  performance,  tho  superiority 
of  tho  more  experienced  group  would  necessarily  bo  limited  to  thoso 
more  fundamental  skills  tho  gradual  acquisition  of  which  is  an  im¬ 
portant  feature  of  learning. 

It  will  be  noted  that  the  two  experimental  procedures  just  described 
test  for  different  kinds  of  relevance:  Tho  first  procedure  tests  ability 
to  discriminate  differences  in  aptitude;  tho  second,  ability  to  dis¬ 
criminate  differences  in  learning.  If  the  students  with  tho  samo  ex¬ 
perience  but  less  aptitudo  make  tho  same  types  of  errors  ns  thoso  with 
normal  aptitude  but  less  experience,  the  two  procedures  will  bo  equiva¬ 
lent.  To  the  extent  that  students  with  low  aptitudo  ond  students 
who  arc  inexperienced  characteristically  mnko  different  kinds  of 
errors,  the  two  methods  will  not  be  equivalent  and  it  will  bo  dcsirablo 
to  select  two  somewhat  different  arrays  of  measures  for  tho  two  differ¬ 
ent  uses.  Measures  selected  by  tho  first  procedure  will  bo  most 
relevant  in  deciding  which  students  should  bo  eliminated  and  in 
validating  aptitudo  tests;  thoso  selected  by  tho  second  will  bo  most 
useful  in  graduating  students  on  a  proficiency  basis,  diagnosing  thoir 
strengths  and  weaknesses,  and  in  evaluating  tho  results  of  training 
experiments. 

Comprehensiveness 

Measures  may  be  relevant,  but  still  partly  inadequate  becauso  tlioy 
cover  only  a  few  of  the  important  factors  involved  in  flying  skill.  If 
a  suitable  over-all  criterion  is  available,  it  is  possiblo  to  determino  tho 
comprehensiveness  of  a  given  set  of  measures  by  seeing  how  well  tho 
combined  score  of  all  of  the  measures  is  able  to  predict  the  criterion. 
Sinco  part  of  tho  failuro  to  predict  perfectly  may  bo  duo  to  tho  un¬ 
reliability  of  tho  criterion  rather  than  to  a  lack  of  comprehensiveness 
of  tho  group  of  measures  being  tested,  it  is  necessary  to  lmvo  somo 
independent  way  of  evaluating  the  reliability  of  tho  criterion.  If  tho 
reliability  of  the  criterion  is  known,  it  is  possible  to  uso  tho  formula 
for  correction  for  attenuation  to  estimato  how  well  tho  measures  would 
predict  a  perfectly  reliable  criterion,11  When  no  comprehcnsivo 
criterion  is  avnilablo  and  ono  is  relying  upon  expert  judgment,  it  is 
especially  important  to  examine  the  comprehensiveness  of  tho  group 
of  measures  to  bo  used. 

»•  Ste  Guilford,  J.  P.,  r>fchom<trle  Sftihodt,  McOraw  Illll  Dwk  Co.,  New  York  ond  London.  IW^ 
p.  307,  formula  IM. 
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If  tho  measures  arc  going  to  bo  routinely  used  to  evaluato  tho 
results  of  training,  the  instructors  will  tend  to  modify  their  teaching 
in  such  a  way  as  to  train  their  students  to  get  tho  best  grades  on  theso 
measures.  Any  continued  use  of  a  system  of  testing  is  bound  to 
exert  a  certain  amount  of  influence  on  tho  curriculum.  If  tho  system 
of  testing  is  one-sided,  the  curriculum  will  bo  distorted;  if  tho  measures 
aro  sufficiently  comprehensive,  they  will  tend  to  keep  tho  curriculum 
properly  balanced.  For  this  reason  particular  attention  was  paid  to 
tho  comprehensiveness  of  tho  measures  developed  by  tho  Pilot  Project. 

Specificity 

Although  tho  battery  of  measures  should  bo  comprehensive,  it  is 
dcsirablo  to  have  the  individual  items  specific  so  that  they  can  bo 
used  to  diagnoso  tho  student’s  strengths  and  weaknesses  and  as 
differential  criteria  for  validating  aptitudo  tests.  Ono  of  tho  defects 
of  subjcctivo  measures  is  their  susceptibility  to  “halo  effect.”  Tho 
rater  is  likely  to  bo  influenced  by  his  general  impression  so  that  ho 
tends  to  ignoro  tho  good  points  of  poor  students  and  tho  weak  points 
of  good  ones. 
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CHAPTER  FIVE 


Studies  of  Subjective  Measures 
of  Flying  Proficiency 

Cnpt.  Avrum  II.  Ben-Avi  u 


INTRODUCTION 

Since  more  than  onc-third  of  tho  students  starting  tho  expensive 
process  of  flying  training  were  eliminated  for  flying  deficiency,  it  was 
important  to  have  an  accurate  way  of  measuring  their  ability  so  that 
good  students  would  not  bo  eliminated  or  poor  ones  allowed  to  con¬ 
tinue.  The  grading  system  developed  for  this  purposo  was  similar  at 
tho  various  levels  of  training  in  tho  Training  Command.  In  general, 
three  types  of  flying  grades  were  given:  Daily  grades,  progress  or 
elimination  check-ride  grades,  and  final  proficiency  ratings.  All  three 
types  of  grades  were  subjective,  in  terms  of  categories  such  as  A,  B, 
C,  D,  E,  and  F,  which  were  based  upon  the  experience  and  judgment 
of  the  instructor  or  check  pilot. 

Tho  daily  grades  wero  based  on  the  instructor’s  observations  during 
routine  training  flights.  Tho  instructor  either  flew  with  tho  student 
or,  in  some  of  tho  moro  advanced  stages  of  training,  flow  alongsido  of 
him  in  another  airplane.  Chcck-rido  grades  wero  based  upon  ob¬ 
servations  made  by  an  experienced  check  pilot  during  an  official  check 
ride.  In  some  eases,  the  check  rider  was  required  to  includo  a  specified 
list  of  maneuvers;  in  other  cases,  he  was  allowed  complcto  freedom  to 
select  any  maneuvers  which  had  been  included  in  tho  student’s  training 
up  to  that  point.  At  tho  completion  of  each  phase  of  training,  tho 
student  pilot  was  rated  on  various  aspects  of  his  performance  and  theso 
ratings  were  forwarded  to  tho  next  school. 

•  Since  tho  various  subjective  flying  grades  used  in  tho  training  pro¬ 
gram  wero  the  most  readily  available  criteria  against  which  to  validato 
aptitude  tests  for  tho  selection  of  pilots,  various  organizations  in  tho 
Aviation  Psychology  Program  made  different  studies  of  theso  grades. 
Tho  studies  relevant  to  each  aspect  of  tho  grading  system  aro  sum¬ 
marized  in  the  following  sections.11 


S/?g t.  Charles  P.  Oershenaon  assisted  In  the  preparation  of  the  manuscript  for  this  chapter. 

»» Unless  otherwise  specified,  studies  annlyrine  dally  erodes  and  chcck  rlde  erodes  were  performed  at 
Psychological  Research  Unit  2.  TIiIj  series  of  projects  was  supervised  and  conducted  by  Ma).  M.  P.  Craw, 
ford.  Capt.  1.  T.  Dailey,  Lt.  J.  T.  Cow  les,  Lt.  It.  i.  Keller,  T/Sgt.  K.  S.  Schrader,  8/Bgt.  II.  K.  Bchimmseee, 
8gt.  R.  W.  Uneer. 
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CRADUATION-KLIMINATION  AS  A  CRITERION 


The  chief  criterion  used  in  evaluating  the  selection  and  classifica¬ 
tion  tests  developed  in  the  Aviation  Psychology  Program  was  gradua¬ 
tion  or  elimination  from  pilot  training.  This  was  also  one  of  tho 
criteria  which  the  Pilot  Project  used  in  evaluating  objective  measures 
of  flying  skill.  In  using  this  criterion,  the  few  students  eliminated  for 
reasons  other  than  flying  deficiency  were  discarded.  This  criterion 
was  selected  for  two  related  reasons:  (1)  Its  obvious  practical  impor¬ 
tance,  since  eliminces  represented  a  considerable  waste  of  time  and 
money;  (2)  tho  fact  that  because  of  its  practical  importance,  tho 
schools  expended  the  maximum  effort  of  making  this  decision  as 
candidly  as  they  could. 

That  this  criterion  wus  far  from  ideal,  however,  will  become  evident 
as  the  various  measures  upon  which  it  is  based  aro  discussed  in  sub¬ 
sequent  sections  of  this  chapter.  Whenever  this  criterion  is  used  to 
evaluate  the  subjective  measures  described  in  this  chapter,  it  is  impor¬ 
tant  to  remember  that,  since  these  measures  entered  into  tho  process 
of  making  tho  pass-fail  decision,  it  is  by  no  means  a  completely  inde¬ 
pendent  criterion  for  these  measures.  Indeed,  in  tho  caso  of  tho 
check  ride,  tho  mcasuro  was  tho  direct  basis  for  passing  or  failing 
tho  student. 

A  dichotomous  criterion  of  pass-fail  restricts  tho  precision  of  pre¬ 
diction.  Also  the  very  nature  of  tho  pass-fail  criterion  tends  to  inter¬ 
fere  with  its  evaluation  sinco  tho  failures  aro  not  available  for  further 
study.  In  addition  to  theso  briefly  mentioned  qualities  of  this  cri¬ 
terion,  was  a  third,  that  of  variability  which  is  considered  in  greater 
detail  below. 

Variability  in  Elimination  Rate 
# 

There  was  a  great  deal  of  cvidenco  that  different  commands  and 
schools  had  varying  standards  for  grading  their  students.  Evidcnco 
for  this  is  reflected  by  tho  dissimilar  elimination  rates  among  schools 
and  commands.  Table  5.1  abstracted  from  a  study  by  Lt.  Col.  J.  P. 
Guilford  at  Psychological  Section,  Offico  of  tho  Surgeon,  Hq.  Army 
Air  Forces  Training  Command,  illustrates  tho  variability  of  climina-. 
tion  rates. 

The  following  conclusions  wero  drawn  from  this  study  :(1)  Elimina¬ 
tion  rates  ranged  from  10  percent  to  GO  percent  in  tho  2G9  class 
groups,  with  dispersions  two  to  threo  times  thoso  to  bo  expected  by 
random  sampling.  Even  when  differences  duo  to  variations  in  aver¬ 
age  level  of  aptitude  (measured  by  pilot  staninc)  wero  allowed  for,  large 
differences  remained;  (2)  tho  greatest  differences  were  found  botween 
commands;  (3)  in  some  commands  the  greater  differences  wero  between 
successive  classes,  and  in  others,  between  schools  in  tho  samo  class; 
(4)  schools  did  not  recognizo  differences  between  class  groups  nearly 
as  well  as  they  did  between  individuals  in  tho  samo  class. 
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Tahlk  5.1. — Distribution  of  the  elimination  rates  in  primary  school  classes  1,3-0, 

43  II,  43-1,  43-J,  and  48-K 
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•  The  elimination  rule  lor  rich  claw  nt  each  school  was  computed  ami  tabulated  separately.  Thus,  In 
WFTC  one  class  at  a  school  hi<l  an  elimination  rate  from  ft  10  I'ercent,  sis  had  rates  from  It  15  percent,  etc. 

•  Tho  standard  error  of  the  percentage:  computed  In  each  csiso  on  the  hypotheses  of  an  over-alt  elimination 
rate  of  31.7  percent;  the  sire  of  tho  simples  was  taken  ns  the  mean  sire  of  class,  that  Is,  17ft,  10ft,  and  225  for 
the  three  commands,  rcs|>cctivcly,  and  105  for  the  entiro  Training  Command. 

EFTC,  CFTC,  and  WFTC  refer  to  Eastern,  Central,  and  Western  Flying  Training  Commands, 
respectively. 

Other  psychological  units  conducted  studii'3  which  demonstrated  tho 
existence  of  similar  variability  in  the  elimination  rates  of  different 
schools.  In  tho  Western  Flying  Training  Command,  Psychological 
Research  Unit  No.  3  demonstrated  that  for  Classes  43-A  through  D, 
the  elimination  rate  for  flying  deficiency  at  one  school  was  as  low  as  14 
percent,  while  that  of  another  was  os  high  os  42  percent.  Psychologi¬ 
cal  Research  Unit  No.  2  reported  similar  results  for  classes  43-D  to 
43-1  in  Central  Flying  Training  Command.  There  tho  elimination 
rate  for  flying  deficiency  was  22  percent  for  tho  lowest  school,  and 
41  percent  for  the  highest  school.  Each  of  tlieso  elimination  rates  was 
based  on  approximately  1,000  coses;  tho  differences  wero  far  greater 
than  thoso  expected  by  clmnco. 

All  results  indicated  that  thcro  were  substantial  differences  in  tho 
standards  of  tho  various  schools.  After  making  a  field  trip  to  study 
this  problem,  two  officers  of  Psychological  Research  Unit  No.  2  con¬ 
cluded  that  the  supervisory  personnel  and  instructors  at  ono  school 
wero  convinced  that  it  was  their  duty  to  eliminate  any  students  whom 
they  felt  would  not  develop  into  excellent  pilots;  whilo  thoso  in  another 
school  believed  that  it  was  their  duty  to  graduato  any  students  whom 
they  considered  reasonably  capable  of  succeeding  in  later  stages  of 
training. 

Considerable  effort  was  devoted  to  the  standardization  of  elimina¬ 
tion  policies,  especially  during  the  latter  part  of  tho  war.  When 
students  wero  assigned  to  schools,  consideration  was  given  their 
aptitude  scores  in  an  attempt  to  equate  classes  for  aptitude.  Stand¬ 
ardization  boards  were  organized  in  each  of  the  training  commands 
which  were  responsible  for  visiting  the  various  schools  and  checking 
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on  the  standards  for  elimination.  These  efforts,  however,  never 
completely  achieved  the  goal  of  establishing  uniform  and  standardized 
procedures. 

Reliability  of  the  Pass-I'ail  Criterion 

The  reliability  of  the  pass-fail  criterion  could  not  bo  evaluated 
directly  in  the  normal  training  situation,  since  the  failures  were  not 
available  for  any  second  appraisal.  Tho  experiment  in  which  tho 
Pilot  Project  planned  to  have  students  retained  who  would  otherwise 
have  been  eliminated,  could  not  be  carried  out  with  mean  ":gful  results 
because  of  the  disruption  of  training  in  the  period  following  shortly 
after  the  end  of  the  war.  One  may  deduce,  however,  that  the  pass-fail 
criterion  has  a  certain  amount  of  reliability,  since  it  can  be  predicted 
by  tiio  pilot  stnninc.  From  data  which  are  available  it  is  possiblo  to 
estimate  the  minimum  reliability  of  the  criterion. 

On  an  experimental  group  of  over  1,000  students  who  were  not 
selected  on  tho  basis  of  their  aptitude  test  scores,  the  correlation  be¬ 
tween  the  pilot  staninc  and  the  pass-fail  criterion  for  complete  pilot 
training  was  O.GG.  This  is  the  figure  which  is  relevant  in  evaluating 
the  staninc  as  a  method  of  selecting  students  for  pilot  training. 

Under  ordinary  circumstances,  however,  only  tho  students  with 
ihc  higher  stanincs  were  sent  to  training.  Thus,  tho  group  normally 
in  pilot  training  was  highly  selected.  Once  theso  students  were  se¬ 
lected,  the  problem  for  training  research  was  to  sccuro  rcliablo  measures 
on  this  group  in  spite  of  tho  restricted  range  of  talent.  Tho  relevant 
figure  for  estimating  the  reliability  of  the  pass-fail  criterion,  therefore, 
is  the  correlation  of  the  pilot  sianino  with  pass-fail  for  tho  group  of 
high-stanino  students  sent  to  training.  On  one  largo  samplo  this 
correlation  was  0.40."  Similarly,  tho  reliability  of  tho  pilot  stanino 
was  0.94  for  the  relatively  unsclccted  population  which  is  relevant  to 
evaluating  tho  staninc  as  a  sclcctivo  device,  and  may  bo  estimated  as 

O. 84  for  the  restricted  group  retained  for  training.'*  By  using  tho 
values  of  0.40  and  0.84  in  tho  formula  for  correcting  a  correlation 
coefficient  for  attenuation,  it  can  bo  estimated  that  tho  reliability  of 
tho  pass-fail  criterion  could  not  iravo  been  below  (hlO.*0  This  is  a 
minimum  estimato  of  reliability  bccauso  it  assumes  that  if  it  were 
not  for  tho  unreliability  of  tho  stanino  and  criterion,  tho  stanino 
would  bo  a  perfect  predictor. 

Another  very  rough  approximation  of  the  reliability  of  tho  pass-fail 
criterion  may  bo  obtained  in  a  different  way.  On  a  samplo  of  2,905 

»•  Tlib  figure  l»  based  on  53.7SS  students  In  classes  44-J  through  43- F  tested  by  the  November  1043  battery. 

11  The  vnlue  of  0  04  Is  n  corrected  (S|»e.trmtvn-Ilrown)  odd-even  reliability  of  the  aggregate  weighted  (cores 
for  •  sample  of  1 ,0.0  coses  tested  from  30  January  1014  to  14  February  1014.  This  study  wasdliwtcd  by  MaJ. 

P.  II.  Dullols  mid  1.1.  A.  K.  Jrnn ess  at  Medical  and  Psychological  K  earn  tiling  t'nlt  No.  7.  The  other 
figure  was  estimated  by  using  the  formula  for  correcting  a  reliability  coefficient  for  heterogeneity  which  U 
dlscu*3<d  In  Kelley,  T.  I...  Ftatiitleal  .Xfr/Aed,  poges  ‘.’51-23.  The  standard  deviations  of  the  stanincs  In  lb« 
restricted  and  unrestricted  samples  wrre  assumed  to  be  the  same  os  those  In  the  sample  cited  In  the  pro* 
ceding  footnote. 

"  Peters  mid  Von  Voorhts,  Nfeffsf  ktf  PrtKtduttt  Their  Malhematleal  Rem,  Formula  121,  page  203. 
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students,  ratings  of  general  pilot  ability  made  at  the  Primary  level  of 
training  correlated  0.27  with  later  ratings  made  at  Basic.  Theso 
two  ratings  were  independent.  They  were  made  at  each  school  by 
the  same  personnel  who  were  responsible  for  passing  or  failing  the 
student.  Bccauso  they  were  less  important  than  tho  decision  to  pass 
or  fail  the  student,  these  ratings  were  probably  mndo  with  somewhat 
less  care.  Assuming  that  the  ratings  at  tho  two  levels  of  training  wero 
of  approximately  equal  reliability,  the  reliability  of  each  must  havo 
been  at  least  0.27.  Any  differences  in  tho  skills  required  at  tho  two 
levels  of  training  or  changes  occurring  in  the  students  during  tho  10- 
week  period  between  ratings  would  lower  the  correlation  between 
them.  In  this  senso  it  is  a  conservative  estimato  of  their  reliability. 

It  is  also  an  estimate  for  a  population  with  a  restricted  rango  bccauso 
it  docs  not  involve  the  students  who  failed  in  Primary  and  hcnco  never 
went  to  Basic.  This  restricted  population  is  tho  relevant  ono  for 
estimating  the  reliability  of  flying  grades  at  tho  Basic  level.  Tho 
estimate  for  the  reliability  at  the  Primary  level,  however,  should  bo 
corrected  in  order  to  apply  to  the  less  restricted  rango  involved  thcro. 
For  500  students  in  Pilot  Classes  44-H,  I,  and  J  at  Jones  Field,  Bon¬ 
ham,  Tex.,  the  standard  deviation  of  tho  flying  grades  of  students 
graduating  from  Primary  to  Basic  was  found  to  bo  0.70  of  that  of  tho 
entire  class  before  the  weaker  students  were  failed.  Using  this  figure 
in  Kelley’s  formula  for  correction  for  heterogeneity,  it  may  bo  esti¬ 
mated  that  the  reliability  of  flying  grades  on  tho  entire  rango  of  tho 
Primary  population  is  somewhere  in  tho  vicinity  of  0.05.  Since  this 
is  an  indirect  estimato  based  on  a  number  of  possibly  inexact  assump¬ 
tions,  it  must  be  taken  as  a  very  rough  approximation. 

PROGRESS  CHECK  RIDES 

Introduction 

Tho  Progress  Checks  were  given  routinely  to  tho  students  at  tho 
completion  of  the  main  stages  of  training  throughout  tho  courso  of 
flying  training.  In  addition,  any  timo  tho  student’s  dnily  grades 
were  not  satisfactory,  he  was  given  a  progress  check  rido. 

Progress  checks  wero  given  by  special  check  pilots,  tvho  usually 
referred  to  the  student’s  daily  grade  slips,  and/or  discussed  tho  stu¬ 
dent’s  weaknesses  with  his  instructor  before  tho  check,  so  that  tho 
check  rido  would  be  devoted  to  tho  critical  areas  of  tho  student's  per¬ 
formance.  A  few*  check  pilots  preferred  to  know  nothing  about  tho 
student’s  performance  prior  to  tho  check  rido.  In  almost  every 
instance,  however,  the  check  pilot  discussed  his  opinion  of  tho  student 
with  the  instructor  following  the  check  ride  in  order  to  compare  his 
evaluations  with  those  of  the  pilot  who  lmd  observed  the  student  over 
a  longer  period. 

If  tho  check  pilot  believed  that  tho  student  had  promise,  ho  was 
returned  for  further  training  with  another  instructor.  If  not,  ho  was 
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given  Another  ride  hy  a  second  check  pilot.  If  tho  two  check  pilots 
Agreed  tlmt  the  student  should  not  be  allowed  to  continue  in  trAining, 
lie  was  eliminated.  For  the  poorest  students,  the  second  check  ride 
was  more  or  less  a  matter  of  form;  on  the  other  hand,  some  students 
received  as  many  ns  a  dozen  check  rides  before  finally  being  eliminated 
or  graduated  from  the  school.  In  a  typical  Primary  school  investigated 
by  Psychological  Research  Unit  No.  2  it  was  found  that  the  836 
students  in  classes  44  -11  to  44-K  were  given  an  averago  of  4.1  check 
rides  by  pilots  other  than  their  own  instructors. 

In  evaluating  these  studies  it  should  be  remembered  that  successive 
evaluations  in  check  rides  at  the  same  school  aro  not  independent  of 
each  other  or  of  instructors'  grades. 

Relationship  to  Pass  Fail 

Attempts  at  determining  tho  relationship  of  mean  check-ride 
grades  with  graduation-elimination  have  resulted  in  biserial  correla¬ 
tion  coefficients  of  about  1.00,  when  Primary  pass  fail  was  used  as  tho 
dichotomous  variable.  These  results  substantiate  the  statement  that 
elimination  from  Primary  school  was  based  directly  upon  tho  results 
of  check-ride  grndes. 

Relationship  to  Success  in  Subsequent  Phases  of  Training 

The  ability  of  grades  at  one  level  of  training  to  predict  subsequent 
performance  was  an  important  practical  test  of  a  measure's  validity. 
It  was  also  a  rigorous  test  since  it  was  reasonably  certain  that  the  two 
estimates  of  performance  at  tho  different  levels  of  training  were 
independently  made. 

A  study  conducted  at  Psychological  Research  Unit  No.  2,  deter¬ 
mined  tho  ability  of  average  chcck-rido  grades  for  tho  Primary  stago  of 
training  to  predict  various  criteria  of  performance  at  the  Basic  and 
Advanced  stages.  Tho  results  from  this  study,  presented  in  table 
5.2,  show  a  low  positive  relationship  between  average  check-ride 
grades  at  Primary  school,  and  measures  of  proficiency  at  Basic  and 
Advanced  schools. 

In  another  study,  Psychological  Research  Unit  No.  2  found  a 
correlation  of  0.26  between  Primary  and  Basic  average  check-ride 
grades  for  390  cases.  It  is  of  interest  to  noto,  in  tablo  5.2,  that  tho 
pilot  stanino  predicted  success  in  Basic  at  least  os  well  as  did  the 
average  of  tho  cheek-ride  grades  in  Primary. 

The  low  reliability  of  the  subjective  grades  probably  contributed  to 
these  low  correlations.  It  is  also  possible  that  students  who  were  slow 
in  catching  on  at  first  did  better  during  the  later  stages  of  training; 
that  different  levels  of  training  demanded  different  qualities  or  abilities 
from  the  students;  or  that  some  students  changed  their  motivation  or 
attitude.  Whatever  the  reason  for  these  low  correlations,  tho  fact 
that  grades  at  one  level  of  training  did  not  predict  grades  at  tho  next 
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level  of  training  is  of  considerable  practical  importance  in  that  it 
suggests  that  quite  a  few  of  the  students  eliminated  in  Primary  might 
have  received  satisfactory  grades  had  they  been  allowed  to  proceed  to 
Basic. 


Tatii.k  5.2. — Correlation  of  average  check-ride  grade s  with  subsequent  success  * 
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•  Rased  on  nn  average  of  approximately  4  -'heck  rides  per  student:  the  borderline  cases  received  more 
check  rides  and  tho  extreme  ones  fewer.  All  avenue  check-rldo  crudes  xcere  conxcrted  into  normalized 
scores  by  schools.  If  the  dllTctenccs  between  schools  had  not  been  eliminated  In  this  manner,  the  correla¬ 
tions  xvnuhl  have  l>ecn  still  lower. 

*  Final  siiit<‘mc!its  of  Instructors  on  student  proficiency  were  dlcholomlrcd  Into  an  upper  and  lower  poop. 
Data  from  class  41  II.  Frederick. 

>  All  correlation  coefficients  ore  uneorrreted  Pearsonlan  product-moment,  except  for  correlations  with  the 
Advanced  varinhlc,  which  arc  blscrlal  coefficients. 

Reliability 

Method. — Two  attempts  were  made  in  a  study  conducted  at  Psycho¬ 
logical  Research  Unit  No.  2,  to  arrive  at  estimates  of  tho  reliability 
of  check-ride  grades.  One  method  used  was  the  analysis  of  varianco 
technique  developed  by  Hoyt,11  modified  for  this  specific  situation.*1 
The  second  estimate  of  reliability  was  tho  correlation  between  mean 
check-ride  grades  assigned  by  Army  and  civilian  check  riders  and  cor¬ 
rected  for  double  length  (Spearman-Brown).  Tho  procedure  in  uso 
at  that  time  provided  for  elimination  check  rides  to  he  administered  by 
Army  fliers,  while  regular  check  rides  could  be  given  by  civilian  pilots. 

Population. — Tho  population  used  consisted  of  class  44—11,  Garner 
Field,  Uvalde,  Tex.,  and  classes  44-11  through  K,  Jones  Field,  Bon¬ 
ham,  Tex. 

Conclusion. — Both  techniques  yielded  similar  correlations  ranging 
from  0,72  to  0.S9  in  different  schools  and  different  classes.  It  should 
bo  pointed  out,  however,  that  theso  correlations  yield  maximum 
rather  than  true  estimates  of  reliability  since  tho  Army  check  riders 
were  influenced  by  the  results  of  the  civilian  chock  rides  and  both  check 
riders  wore  influenced  by  daily  grades  and  by  the  instructor’s  opinion. 

What  little  evidence  is  available  indicates  that  when  adequato  pre¬ 
cautions  nro  taken  to  seo  that  the  subjective  evaluations  by  check 
riders  are  made  independently,  the  reliability  is  somewhat  lower  than 
the  figures  quoted  above.  In  a  study  conducted  by  the  Pilot  Project  ** 
46  lower  phnso  Primary  cadets  in  class  4G-A  were  given  an  experi¬ 
mental  check  ride  at  Moton  Field,  Ala.  Tho  correlation  between  two 

•i  Hoyt,  C.  J„  "Test  Reliability  Estimated  by  Analysis  of  Variance,"  Psreksmrtrlts,  190,  S  I.M-ICO. 

«  The  modification  consisted  of  taking  account  of  the  unr'iual  number  of  check  rides  u.->lgned  students  la 
obtaining  the  "within  group"  sums  of  squares.  This  analysis  was  the  work  of  l.t.  It.  j.  Keller. 

#  This  study  was  supervised  by  Lt.  Ralph  Showalter  and  Sjt.  John  It.  Rohrs. 
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individual  chock  riders’  subjective  evaluations  was  0.35.  When  this 
figure  is  stepped  up  by  the  Spearman-Brown  formula  to  predict  a 
reliability  for  a  combination  of  4  check  rides  comparablo  with  the 
reliability  quoted  above  for  an  'average  of  4.1  check  rides,  the  reliability 
becomes  0.G9.  Since  this  study,  which  is  the  only  one  available,  in¬ 
volved  such  a  small  number  of  eases,  the  results  must  bo  taken  only  as 
i\  first,  rough  approximation. 

OFFICERS  PROFICIENCY  CARD— AFTRC  FORM  2 
Introduction 

The  function  and  purpose  of  the  Officers  Proficiency  Card  was 
described  as  follows:  “The  Proficiency  Card  is  designed  to  establish 
a  uniform  system  for  rating  the  demonstrated  proficiency  of  each  indi¬ 
vidual  student  in  each  successive  phase  of  aircrew  training  received  at 
schools  under  the  jurisdiction  of  this  command,  and  also  to  provide 
the  organization  of  first  assignment  with  an  individual  report  on  the 
.  training  and  proficiency  of  each  student  for  use  ns  a  guido  to  facilitate 
training  and  assignment.”24  According  to  the  procedures  recom¬ 
mended,  this  one  form  was  to  contain  a  complete  and  cumulative 
record  of  the  student’s  history  in  the  Training  Command.^  At  each 
phase,  the  student  was  rated  for  certain  military  and  personal  char¬ 
acteristics  as  well  ns  upon  the  pertinent  aspects  of  his  training  course, 
on  a  three-point  scale  ns  follows:  AA  for  abovo  average,  A  for  aver¬ 
age,  and  BA  for  below  average.  A  copy  of  this  form  nppears  on 
pages  381  and  382. 

Discussion 

In  almost  nil  studies  dealing  with  tho  Officers  Proficiency  Card 
AFTRC  Form  2  certain  factors  were  observed  which  arc  relevant  to  its 
use  and  interpretation.  First  was  tho  manner  in  which  the  ratings  on 
tho  card  wero  mndo.  Tho  Psychological  Section,  Hq.  Second  Air 
Force,  found  that  the  filling  out  of  this  form  was  usually  regarded  as 
an  unnecessary  burden.  Tho  feeling  that  it  constituted  an  adminis¬ 
trative  chore,  the  results  of  which  would  never  bo  utilized  was  ex¬ 
pressed,  and  in  many  instances  was  well  founded.  It  was  moro  tho 
exception  than  the  rule  for  instructors  or  supervisors  to  consult  theso 
cards  for  information  relevant  to  the  student’s  previous  training  or 
past  performance. 

Tho  attitude  on  tho  part  of  those  responsible  for  making  tho  ratings 
was  reflected  in  a  number  of  different  ways.  A  survey  conducted  by 
tho  Psychological  Section,  Office  of  tho  Surgeon,  Ilq.  Second  Air 
Force,  nt  ten  Operational  Training  Units  disclosed  that  in  none  of 
theso  were  completed  forms  available  for  more  than  GO  percent  of  tho 
personnel.  Tho  ratings  also  showed  considerable  “halo”  effect, 

•*  T.  C.  Memorandum  1V2,  Proficiency  Card  (AFTRC  Form  No.  2),  Ilq.  AAF  Training  Command, 2S 
February  1044. 
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demonstrated  by  the  fact  tlmt  the  ratings  for  an  individual  were  much 
more  similar  than  the  wide  rango  of  traits  and  performances  being 
rated  would  suggest.  There  was  also  a  serious  restriction  in  tho  range 
of  ratings  within  groups.  It  was  repeatedly  established  that  tho 
majority  of  students  within  a  class  received  tho  samo  rating.  Sub¬ 
stantial  numbers  of  records  were  encountered  on  which  entries  wero 
incomplete  or  improperly  entered.  Entries  from  different  schools 
had  such  different  distributions  that,  when  studies  wero  based  upon 
populations  drawn  from  more  than  one  school,  the  grades  lmd  to  bo 
normalized  to  eliminate  school  differences. 

In  spite  of  these  limitations,  Psychological  Research  Unit  No.  3  in 
working  with  the  AFTRC  Form  2  found  for  classes  44-G,  44-11,  and 
44-J  totalling  approximately  6,000  cases,  that  ratings  of  General 
Pilot  Ability  at  the  Primary  level  correlated  as  highly  with  tho  pilot 
staninc  as  did  graduation-elimination.”  Theso  ratings  wero  also 
positively  and  significantly  correlated  with  other  measures  of  perform¬ 
ance  in  the  Primary  phase  of  pilot  training.  The  other  measures  wero 
flying  grades,  amount  of  dual  instruction  prior  to  initial  solo  flight, 
and  a  three-category  rating  by  instructors.  In  a  later  study,  tho  samo 
unit  found  that  tho  correlation  between  the  pilot  stanino  and  tho 
rating  on  General  Pilot  Ability  in  Basic  schools  was  0.38  for  1,507 
students.** 

Prediction  of  Subsequent  Performance 

The  following  table  summarizes  tho  results  of  experiments  designed 
to  evaluate  the  predictive  power  of  the  rating  of  General  Pilot  Ability 
on  the  Proficiency  Card.  It  can  be  seen  that  all  these  correlations  nro 
low,  ranging  from  0.23  to  0.34.  They  aro  of  about  tho  same  order  as 
thoso  for  average  chcck-rido  grades. 

Tho  Psychological  Section,  Offico  of  tho  Surgeon,  Ilq.  Second  Air 
Force,  investigated  the  relationship  between  Training  Command  rat¬ 
ings  on  tho  AFTRC  Form  2  ud  similar  ratings  of  proficiency  in  opera¬ 
tional  training.  The  results  of  this  study  indicated  that  individuals 
given  a  high  rating  in  tho  AAF  Training  Command  tended  to  do  better 
in  operational  training  than  did  individuals  given  poor  ratings. 
Correlations  between  estimates  of  proficiency  in  tho  Training  Com¬ 
mand  and  in  tho  Second  Air  Force  were  between  0.30  and  0.40.  Thcro 
was  a  definite  tendency  for  correlations  between  ratings  in  tho  two 
commands  to  bo  higher  with  tho  moro  specific  and  clearly  defined 
ratings  in  the  Second  Air  Force.  It  was  also  apparent  that,  in  general, 
ratings  mado  at  Basic  and  Advanced  schools  correlated  higher  with 
operational  criteria  than  did  ratings  in  Primary. 

The  finding  that  tho  moro  specific,  clearly  defined  ratings  wero 
better  was  also  evident  in  a  study  by  Psychological  Research  Project 


**Thls  study  wu  done  by  Cept.  R.  If.  ITcnnemnn  end  Pit.  8.  II.  Marsh. 
*•  Capt.  R.  II.  Uenneman  and  Sit.  R.  C.  Anderson  conducted  this  study. 
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(Pilot).  It  was  demonstrated  that  ratings  of  flying  ability  were  some¬ 
what  more  predictive  of  success  in  Central  Instructors  School  than 
were  the  ratings  on  personal  qualities.  It  was  also  found  that  cer¬ 
tain  of  the  specific  flying  ratings  (such  ns  the  one  on  formation  flying), 
were  about  ns  predictive  of  success  at  Central  Instructors  School  as 
the  rating  of  General  Pilot  Ability.  The  simple  sum  of  the  best 
specific  ratings  on  the  form  gave  a  considerably  better  prediction  of 
success  at  Central  Instructors  School  than  did  the  rating  of  General 
Pilot  Ability.  Since  the  best  ratings  were  selected  on  the  basis  of  tho 
same  sample  used  to  validate  the  prediction  of  the  combined  score, 
this  prediction  will  be  expected  to  shrink  somewhat  on  subsequent 
cross  validation. 

Conclusions 

The  ability  of  the  grades  recorded  on  the  Proficiency  Card  to  meas¬ 
ure  proficiency  and  predict  future  performance  was  reduced  by  the  lack 
of  uniformity  in  the  methods  used  to  procure  these  grades,  irregularity 
and  omissions  in  making  the  ratings,  and  the  fact  that  iinminy  eases, 
the  individuals  who  made  the  ratings  on  this  card  did  not  have  any 
clear  idea  of  their  possible  importance.  In  general,  the  moro  specific 
and  better  defined  ratings  were  more  closely  related  to  success  in 
flying  training.  The  simple  sum  of  these  ratings  seems  to  bo  better 
able  to  predict  success  than  the  over-all  ratings  of  General  Pilot  Ability. 
Proficiency  Card  ratings  were  more  highly  correlated  with  other  meas¬ 
ures  of  proficiency  at  the  same  level,  than  with  grades  at  subsequent 
phases  of  training.  This  was  probably  because  the  other  measures 
at  the  same  level  influenced  the  ratings  which  were  placed  on  tho  card. 


Tadi.F.  5.3. — Correlation  of  the  rating  for  general  pilot  ability  on  the  proficiency  card 
with  subsequent  Measures  of  general  pilot  ability 


Level'  of  training 

Measure  predicted 

N 

r • 

Source 

Primary  ».  Da'lt . 

Proflclrnry  enrd  I . 

2W5 

r.st 

rail 

AM 

2W5 

*:.2 

bS3 

....  ”.”P 

ausssseij 

PRP(P). 
PKUI3. 
PIIU  13. 
PKP(P). 
PKP(P). 
PUP(P). 
PKP(P). 

Prim  try  $.  It'iMc. .  .  . 

rroflclt  nry  card . 

Primary  r.  Rule  . 

Final  grad* . 

Under.  CIS  . 

liable  r.  Advance!  . 

Pos'-fnll . 

I’roflrl  ncy  enrd . 

Advanc'd  r.  Trandtlon  .  . 

Advanc'd  r.  CI3... . . 

Transition  record . 

Pass-fail . 

i  Proficiency  cut!  rmdi  s  are  nil  mtlnps  of  General  Pilot  Ability. 

•  Corfi'l  itluni  which  are  either  uncorrected  Utrachorlc  ronvl  itlom  or  have  been  corrected  for  grouping 
Into  I'wul  e.iticorlrs  nro'rdlns  to  tlir  procedure  di'crlNd  In  l’i ten  and  Van  VoorhU  Stjthtical  Procedures 
and  Their  Malhetwilievl  Ihiiri.  (|i|t.  3'J3-3W.) 

‘  DliTrn  tun  l>rt  wren  Jrliooli  hove  N  rn  eliminated  bjr  normnllrlnp  data,  by  nnalytlnit  each  pair  of  school) 
(one  nt  radi  Irvrl)  separately  and  cotnhlning  correlations  by  idrunsfonuutlon,  or  by  mini  single  pain  of 
»chool<. 

Ml  I’d’)  Is  Psychological  Research  Project  (Pilot). 

PHU  Id  Is  Psychological  lUv.mh  Unit  No.  1. 


ANALYSIS  OF  STAGE-GRADES 

Introduction 

In  Primary  schools  the  students  wero  given  certain  flying  exercises 
called  stages.  Grades  of  performance  on  theso  stages  wero  entered  in 
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each  student’s  daily  log  hook.  In  one  study  of  stage  grades,  the 
population  consisted  of  approximately  500  students  in  classes  4*1—11 
I,  and  J  from  the  elementary  school  at  Jones  Field,  Bonham,  Tex. 
The  variables  studied  arc  listed  below.  For  all  except  the  last  two,  a 
letter  grade,  A,  B,  C,  D,  or  E  was  assigned.  In  computation,  theso 
were  weighted  5,  4,  3,  2,  l,  respectively. 

Supervised  solo. — This  is  an  average  of  three  grades  assigned  by  tho 
student’s  own  instructor  on  the  basis  of  his  first  three  solo  flights. 
These  involve  taking  off,  circling  the  field  and  landing  with  no  traffic. 

Solo  stage. — This  is  the  same  as  the  supervised  solo,  except  that  it  is 
performed  m  traffic  and  a  single  grade  is  assigned  by  the  instructor  in 
charge  of  the  stage.  All  of  the  stage  grades  are  assigned  in  this 
manner  with  the  instructors  taking  turns  as  "stage  commanders." 
Instructors  do  not  have  their  own  students  for  stages,  except  for  tho 
supervised  solo  stage. 

90-degree  stage. — This  involves  accuracy  landings  from  a  90-degrco 
approach  in  traffic.  These  accuracy  landings  involve  landing  as 
closely  ns  possible  to  a  prominent  white  line  across  the  runway  area. 
Both  accuracy  and  technique  arc  considered  in  assigning  grades. 

ISO-degree  stage. — This  is  the  same  ns  the  90-dcgreo  stage  except 
that  a  180-dcgrce  approach  is  employed. 

Power  stage. — This  involves  accuracy  landings,  as  defined  abovo, 
made  from  a  power  approach. 

Cross-country  stage. — This  involves  flying  a  triangular  courso  of 
about  300  miles.  Grades  are  given  on  tho  bnsis  of  tho  student’s 
over-all  performance  during  the  flight. 

Hurdle  stage  grade. — The  student  tries  to  land  his  airplano  in  a 
small  circle  from  a  straight  power  approach  over  a  6  to  8  foot  hurdlo 
placed  just  short  of  the  landing  circle.  The  grade  is  an  over-all  rnting 
on  both  accuracy  and  teclmiquo. 

Hurdle  stage  score. — This  score  is  nn  objective  score  based  on  tho 
number  of  times  the  cadet  succeeds  in  landing  inside  tho  landing 
circle.  It  is  nss;gncd  at  the  same  time  nnd  by  the  same  grader  as  tho 
hurdlo  stage  grade.  Scores  may  range  from  6  to  35. 

Hours  dual  bejore  solo. — This  variable  is  the  total  number  of  hours 
of  dual  instruction  before  the  first  supervised  solo.  Since  this  valuo 
should  bear  an  inverse  relationship  to  rapidity  of  progress  in  learning, 
it  was  decided  to  correlate  it  with  tho  other  measures  in  tho  study. 
Because  of  the  nature  of  the  variable,  all  correlations  with  it  lmvo  been 
reversed  ir.  sign  to  show  positive  association  with  desirablo  perform¬ 
ance.  Since,  by  directive,  all  cadets  must  have  at  least  8  hours  of  dual 
before  solo,  this  variablo  is  highly  skewed,  although  tho  function  it 
measures  is  probably  much  more  nearly  norma!!’'  distributed.  Thun, 
it  was  decided  to  dichotomize  hours  dual  bef.>:o  solo  at  tho  median 
and  compute  biscrinl  correlations  against  this  dichotomy. 
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Correlation  with  Pnss-I’ail 

In  table  5.4  given  below  arc  the  correlations  of  certain  of  the  stage 
grades  with  pass-fail. 

Intcrcorrclations 

In  table  5.5  arc  given  the  intcrcorrclations  of  the  stago  grades  and 
other  related  variables. 

Conclusions 

In  general,  the  intcrcorrclations  between  stage  grades  aro  very  low, 
even  though  some  of  the  stages  represented  very  similar  maneuvers. 
This  seems  to  indicate  that  the  stage  grades  were  cither  lacking  in 
reliability  or  measured  highly  specific  variables.  In  cither  case  they 
appear  to  be  of  little  value  as  criteria  of  pilot  proficiency.  The  pilot 
staninc  predicted  pass-fail  better  than  did  any  of  tho  stago  grades. 
The  stage  grades  did  not  correlate  appreciably  with  tho  pilot  stanino, 
average  check-ride  grade,  pass-fail  or  even  with  each  other. 

ANALYSIS  OF  DAILY  GRADES 

The  daily  grade  sheet  consisted  of  a  list  of  maneuvers  and  exercises 
which  were  taught  in  Primary,  along  with  categories  for  evaluating 
tho  student’s  Attitude,  Judgment,  Progress,  and  Technique.  Tho 
student’s  performance  for  each  maneuver  was  routinely  evaluated 
during  each  flight  on  a  scale  from  A  to  F.  Each  grado  below  C  was 
amplified  by  a  written  statement  describing  his  weakness.  Tho 
analyses  presented  below  were  conducted  on  both  the  grades  and  tho 
comments.  Copies  of  the  Primary  Daily  Grado  slip  forms  appear 
in  tho  uppendix. 


Tajii.k  5.4.  —Correlations  of  hours  thiol  before  solo,  average  supervised  solo  grade, 
solo  *itige  grade,  mean  check-ride  grade,  and  pilot  slanine  with  primary  pass-fail 


Supervise*!  polo . 

8olo  stags . 

Hours  dual  before  solo  *. 
Mean  cheek  -ride  trend*.. 
Tllot  sUnlns . 


Class 

D 

Ms 

M. 

M, 

SIh 

rife 

44-11. 

ua 

0  00 

m 

3. 13 

3.41 

a  23 

44-1 

■o 

.47 

3  12 

3. 21 

.04 

HUMi’  1 

44  J  .. 

139 

•  S9 

|o 

3.33 

.4/ 

.26 

41-11. 

154 

.93 

till 

2  02 

.00 

.11 

44-1.. . 

ISA 

.47 

3  01 

un 

l»!l 

.03 

HSW'  1 

44-J  . 

133 

.49 

3.23 

2. 04 

3.19 

.04 

.49 

IP 

K*3 

pE  1 

•.06 

44-1... 

100 

.80 

».  15 

44-J  .. 

139 

.49 

*.28 

4t-H.. 

K2 

.91 

2  63 

1.29 

2  53 

.70 

*.97 

44-1... 

190 

.4(1 

2  f.9 

1. 13 

El 

.43 

.91 

44-J  .. 

139 

.49 

2.32 

1.00 

2. 34 

.80 

.99 

41-H.. 

103 

.91 

A  43 

3.33 

A  38 

1.  40 

•31 

41-1... 

IOO 

.44 

A  49 

3.41 

M0 

1.27 

.29 

44-J ... 

139 

.49 

a  99 

3.40 

a  66 

.43 

Avcraga 

r' 


an 


.24 


.17 


.97 


•  Combined  hv  FI, tier's  t-tmnsformMlo.i. 

'  IM<  hotomped  nt  median. 

•  Tctru-lmr'c  rn-ffld< nt  obtained  bjr  computing  four-fold  point  correlation  and  correcting  foe  unequal 
diet  "ti.my  <-f  crit.-rloii  variable, 

•  Tlic<e  hi  -h  correlations  confirm  the  ob'crvntlon  that  the  cheek -rid#  grades  are  tb«  basis  for  passing  or 
filling  >t iiilcuts. 

•  TcM**d  under  both  July  and  November  43  Directives.  No  correction  for  restriction  In  rang*  attempted 
for  class  It-U  only. 
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Table  5.5. — Intercorrelations  of  stage  grades,  check-ride  grades,  end  slanines  for 

class  44-11,  Jones  Field  1 


N 

i 

n 

n 

B 

• 

• 

7 

D 

a 

10 

1.  Supervised  solo . 

141 

0.30 

a  15 

-0.01 

0.1^ 

0  07 

0.  IS 

a  i5 

0. 19 

a  is 

2.  Soio  stage  . 

Ml 

0.30 

.07 

.  12 

.  It 

.00 

.02 

.07 

.04 

.  12 

3.  00*  stage  . 

.IS 

.07 

H  ID 

.  10 

-.04 

-.  18 

.00 

.07 

— ,  00 

Of 

■4,  ISO®  stage . 

—.01 

.  12 

■  ti 

.07 

.02 

.08 

.00 

.  12 

OS 

6.  Power  stipe  . . .  . 

147 

?4 

.11 

B 

.07 

.  14 

-.02 

.04 

.  14 

.07 

0.  Cross  country  . .  . . 

so 

.07 

.00 

B  tl 

.02 

mtn 

14 

-.03 

.10 

.It 

7.  Hurdle  stipe  grade  . 

IIS 

.  15 

.02 

Ml  tm 

.08 

Hflrl 

14 

.S2 

-.05 

.It 

8.  Hurdle  stage  score  1 . 

147 

.  IS 

.07 

m  f'*m 

.00 

.04 

-.03 

.82 

.00 

.07 

9,  Pilot  stnnlne  .  .  . 

148 

.  19 

.04 

-.00 

.  12 

.  14 

.  10 

-.OS 

.00 

.20 

10.  Average  check  ride  . 

n8 

.IS 

.12 

.OS 

.03 

.07 

.11 

.11 

.07 

.30 

•  Only  students  who  graduated  from  Primary  were  Included  In  these  computations. 

*  Sign  reversed  to  Indicate  association  of  good  jterfot  nunces. 


Table  5.6. — Correlation  between  the  average  grade  during  the  first  four  weeks  of 
primary  training  and  that  during  the  last  five  weeks  1 

Samples  of  Class  44-J  (N=*137)  and  44~K  (N=»145) 


Item 

44-J 

*‘  n 

44-K 

F  n 

Combined’ 

r 0  ii 

tn 

1.  Straight  and  level* . 

0.27 

0.24 

0.20 

a  a 

2.  Turns' . 

.34 

.20 

.30 

.40 

3.  Stalls . 

.82 

.64 

.89 

.74 

4.  Spins  . 

.39 

.S0 

.48 

.60 

8.  Landings .  . 

.40 

.82 

.49 

.60 

0.  Forced  landings .  . 

.01 

.70 

.00 

.79 

7.  Attitude  . 

.71 

.77 

.74 

.88 

8.  Triune  .  . 

.S3 

.63 

.89 

.74 

0.  ltelaxatlon . 

.67 

.6.8 

.68 

.81 

10.  Progress . 

.87 

.07 

.02 

.77 

II.  .’udginent . 

.00 

.72 

.09 

.81 

12.  Dally  grade . 

.CO 

.74 

.08 

.81 

*  Since  both  sets  of  grades  were  assigned  by  the  same  Instructor,  tbe  "halo  effect"  probably  makes  the** 
correlations  spuriously  high  as  estimates  of  split-half  rolls  bllity. 

» fly  use  of  Fisher’s  r-transfornintlon. 

•  For  these  two  Items  the  low  ccelliclents  appear  due  to  tha  fact  that  a  maximum  of  one  or  two  grades  we  ra 
assigned  lu  these  maneuvers  during  the  advanced  (lag*. 

Intercorrelations. — Tho  intcrcorrclntions  of  tho  daily  grades  won* 
also  determined,  simply  by  correlating  tho  mean  grades  for  each 
maneuver  or  excrciso  with  overy  other.  Theso  data  aro  given  in 
tablo  5.7. 


Table  5.7. —  / ntercorrclations  of  average  check-ride  grade  and  daily  grades 
Based  on  343  Primary  Students  in  Classes  44-J  and  K 


1 

a 

3 

4 

• 

0 

7 

a 

9 

10 

II 

12 

18 

1.  Avenge  check  ride  * . 

0.00 

on 

an 

0.69 

0.69 

0  so 

m 

0.77 

2.  Straight  and  level . 

0.60 

.84 

.70 

.71 

.73 

.68 

.18 

.73 

.6.9 

.70 

.04 

.78 

3.  Turns . 

.69 

.84 

.81 

.78 

.77 

.74 

■till 

.70 

.09 

.88 

.79 

.84 

4.  Stalls . 

.77 

.70 

.81 

.83 

.79 

.83 

.33 

.77 

.60 

.88 

.81 

.80 

8.  Spins  . 

1W1 

.71 

.78 

.83 

.79 

■fTl 

.27 

.79 

.  6S 

.80 

.77 

.80 

0.  Landings  . 

HJ 

.73 

.77 

.79 

.79 

.79 

.79 

.24 

.82 

.60 

.78 

.73 

.77 

7.  Forced  landings . 

1:1 

.08 

K1 

.83 

.80 

.20 

.20 

.80 

.63 

.84 

.87 

.87 

8.  Attitude . 

.23 

.18 

.33 

.27 

.24 

.24 

.20 

.29 

.33 

.30 

9.  T rattle . 

.C9 

.73 

«  1 

.77 

.79 

.82 

.80 

.24 

.08 

.74 

.70 

.79 

10.  ltelaxatlon . 

.80 

.69 

.69 

.00 

.08 

.00 

.62 

.20 

.OS 

.69 

.09 

.61 

.07 

II.  Progress . 

.77 

.70 

.88 

,8S 

.80 

.78 

.84 

.29 

.74 

84 

.94 

12.  Judgment  . 

.73 

.6.8 

.79 

81 

.77 

.73 

.87 

.32 

.70 

.6.1 

.8* 

.9) 

.93 

13.  Dally  grade . 

.77 

.  75 

.84 

.b0 

U 

.77 

.87 

.30 

.79 

.67 

.90 

*  Bee  text  for  description  of  ways  In  which  the  Instructor  who  gives  the  daily  grades  may  influent*  tha 
student's  averse*  check-ride  grad*. 
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Studies  of  the  Daily  Grade 

First  to  be  considered  will  be  studies  concerned  with  an  evaluation 
of  the  actual  grades  entered  by  the  instructors  on  the  daily-grade  slips. 

Reliability. — The  reliability  of  the  daily  grade  was  estimated  by 
correlating  the  mean  daily  grade  on  each  maneuver  for  the  elementary 
phase  of  Primary  (the  first  four  weeks  of  training)  with  the  mean 
grade  for  the  same  maneuver  for  the  accuracy-and-acrobatics  phase 
(the  In ^t  five  weeks).  The  statistics  for  this  analysis  are  given  in  table 
5.0.  A  survey  of  table  5.6  reveals  that  the  correlations  are  high  for 
most  '/mgle  items  and  for  the  total  daily  grades.  These  correlations, 
howovi  r,  give  a  spuriously  high  estimate  of  reliability,  since  the  grades 
which  were  correlated  were  not  made  independently  by  different 
instructors,  but  were  for  the  most  part  all  assigned  by  the  same  indi¬ 
vidual.  The  fact  that  an  instructor’s  grade  at  one  time  agreed  with 
his  grade  at  another  may  not  mean  that  he  was  able  to  score  the  stu¬ 
dent’s  flying  accurately,  but  only  that  he  formed  a  fixed  opinion  which 
tended  to  persist  from  one  day  to  another.  Such  general  opinions, 
called  “halo  effects,”  have  been  found  to  be  common  in  almost  every 
type  of  subjective  rating. 

In  this  table  it  can  be  seen  that,  with  the  exception  of  the  grades 
for  Attitude,  all  of  the  daily  grades  are  highly  intcrcorrclatcd.  This 
characteristic  is  undesirable  when  the.  goal  is  differential  information 
concerning  the  elements  of  a  grading  system  for  flying  instruction. 
The  high  correlations  substantiate  the  existence  of  “halo”  mentioned 
above,  though,  of  course,  some  correlation  between  theso  grades  would 
be  expected,  since  they  were  measures  of  functions  considered  to  bo 
related.  In  table  5.8  are  presented  the  results  of  a  similar  analysis 
conducted  on  a  different  population,  using  a  larger  number  of  maneu¬ 
vers  than  in  the  study  mentioned  above.  While  with  this  second  sam¬ 
ple  the  intercorrelations  in  general  were  somewhat  lower  than  those 
presented  in  tabic  5.7,  they  continued  to  bo  relatively  high. 

Correlation  with  pass-jail. — The  summary  statistics  for  tho  correla¬ 
tions  of  the  daily  grades  with  pass-fail  arc  given  in  table  5.9.  It  will 
bo  remembered  that  in  many  instances  tho  daily  grades  determined 
whether  or  not  the  student  would  be  sent  up  for  an  elimination  check 
ride.  The  check  pilot  frequently  discussed  tho  student  with  his 
instructor  before  the  check  rido  in  order  to  learn  what  weaknesses  to 
look  for,  and  before  making  a  final  decision,  almost  invariably  com¬ 
pared  his  nppraisal  based  on  one  ride  with  the  instructor’s  opinion 
which  was  based  on  many  more  rides.  In  the  light  of  theso  condi¬ 
tions  it  is  not  surprising  that  tho  correlation  between  the  instructor's 
daily  grades  and  the  check  pilot's  recommendation  for  pass-fail  is 
high.  Tho  highest  correlations  with  pass-fail  are  for  grades  on 
stalls,  spins,  landings,  and  traffic;  the  lowest  arc  on  attitude,  relaxation, 
ami  judgment.  It  is  interesting  to  note  that  although  the  personnel 
at  schools  all  emphasize  the  importance  of  judgment,  their  grades  on 
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this  factor  are  in  the  group  which  has  the  least  relationship  to  whether 
they  pass  or  fail  the  student. 

Factor  analysis. — A  factor  analysis  of  the  data  given  in  table  5.7 
was  performed.  Table  5.10  lowing  the  Centroid  and  Rotated 
Loadings.  for  the  maneuver  grades  is  given  below. 

In  spite  of  the  high  intercorrclations  of  the  maneuvers  and  exercises 
throe  factors  which  appeared  fairly  significant  were  isolated.  Thcso 
were: 

Rotated  Factor  1. — This  factor  had  highest  loadings  for  spins, 
landings,  traffic,  and  forced  landings,  and  had  the  lowest  loadings  for 
attitude,  straight  and  level,  relaxation,  and  turns. 

Rotated  Factor  2. — This  factor  had  the  highest  loadings  for  judg¬ 
ment,  and  forced  landings.  Tho  extremely  low  loadings  for  landings 
and  traffic  in  this  factor  are  worthy  of  noto. 

Rotated  Factor  3. — Although  most  of  the  grades  had  high  loadings 
on  this  factor,  both  straight  and  level  and  turns  had  tho  highest  load¬ 
ings  and  were  nearly  pure  measures  of  this  factor.  This  factor 
appeared  to  account  in  largo  measure  for  the  “halo  effect”  which 
might  be  inferred  from  tho  high  intercorrclations  among  tho  daily 
grades. 

Taiile  5.9. — Correlations  of  daily  grades  with  pass-fail  in  primary  training  1 
[44-J  (N-137;  P.-A3)  H-K  (N-305;  ,-A3)J 


M, 

Af. 

SDt 

This 

M, 

M. 

SD, 

rw# 

r-aver- 
age  44- 
J  A  K 

1.  Ftrnlght  and  lovel  . 

3.00 

ZFS 

0.M 

0.71 

3.  43 

zsn 

ass 

a  92 

asa 

2.  Turns  . . 

3.  21 

Z  42 

.  S7 

.77 

3.  II 

Z08 

.63 

.91 

.87 

J.  Flails  . 

ITT! 

Z  07 

.02 

.83 

Z01 

l.&S 

.73 

.99 

.97 

4.  Spins  . 

3.  IS 

Z  II 

.01 

.03 

3.17 

1.83 

.73 

.08 

.97 

6.  l-amllng.' . 

3. 30 

Z  21) 

.09 

.83 

3.21 

in 

.76 

.97 

.94 

It.  Forced  landings . 

2  03 

sri 

.08 

.74 

Z94 

ftfl 

.77 

.9! 

.89 

7.  Attitude . 

4.  It 

3.  M 

.44 

.33 

4  19 

ull 

.49 

.29 

.32 

8.  Tralllc  . 

zes 

.  S4 

.08 

3.  S3 

Z  13 

.78 

.08 

.98 

9.  Hi'InsMlnn . 

Z  71 

.64 

.70 

ZOO 

Z  80 

.03 

.74 

.76 

10  Pruirrrea . 

.01 

.80 

ZhO 

1.73 

.08 

.88 

.87 

II.  Judgment.  . 

.64 

.74 

Z  91 

1.92 

.09 

.82 

.79 

17.  l»nl!y  grade . 

2. 78 

L80 

.63 

.79 

Z  08 

1.62 

.67 

.88 

.83 

•  Sir  test  fur  dr'cilptlon  of  ways  In  which  the  Instructor  who  gives  tho  dally  grades  may  Influence  whether 
the  student  posses  or  falls. 


Taiii.b  5.10. — Factor  analysis  of  maneuver  grades  in  primary  training 


Item 

Centroid  loadings 

Rotated  loadings' 

I 

D 

II 

III 

*» 

1.  A  venire  cheek  ride . 

a  si 

a  13 

ao3 

ace 

a22 

a  31 

a  er 

7.  Straight  and  level . 

.83 

-.24 

.18 

.28 

.24 

.80 

.78 

3.  Turns . 

.90 

-.20 

.07 

.40 

.18 

.81 

.83 

4.  Fulls . 

.91 

.00 

.08 

.39 

.31 

.64 

.83 

.89 

.09 

-.09 

.64 

) 

.60 

.80 

6,  UiidlnM..  . . 

.87 

.06 

— .  18 

.06 

.00 

.39 

.79 

7.  Forced  landings  . 

.90 

.23 

.09 

.06 

.38 

.34 

.17 

8.  Attitude . 

.32 

-.10 

.21 

mrTi 

.21 

.33 

.17 

9.  Trallle . 

.87 

.08 

-.  17 

.08 

.09 

.38 

.31 

10.  Helatallon  . 

.73 

-.21 

.10 

.29 

.16 

.70 

.00 

II.  Progress . 

.93 

.04 

.12 

.34 

.33 

.70 

.89 

1Z  Judgment . 

.00 

.11 

.24 

.31 

.46 

.61 

.87 

i  Code:  1  has  been  tentatively  mile!  perceptual  Judgment;  II  beadwork;  and  III  motor  technique. 
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Analysis  of  Comments  on  the  Daily  Grade  Slip# 

The  comments  which  instructors  entered  on  tho  grado  slips  to 
amplify  each  grade  C  and  below  were  also  analyzed  by  Psychological 
Research  Unit  No.  2,  in  the  hope  of  establishing  differential  criteria  of 
flying  ability.  The  purpose  of  the  grade  slip  comments  was  to  provido 
a  cumulative  record  of  a  student's  progress  throughout  tho  course. 
For  the  guidance  of  the  instructor  a  standardized  list  of  “Suggested 
Grade-Slip  Entries"  was  provided  for  all  schools  in  Central  Flying 
Training  Command  by  the  AAF  31st  Flying  Training  Wing,  in  chargo 
of  Primary  pilot  training.  Tho  entries  on  this  list  wero  grouped 
according  to  maneuver  and  included  virtually  all  common  deficiencies 
and  mistakes.  Examination  of  the  grade-slip  entries  at  several  schools 
disclosed  that  most  of  tho  grade-slip  comments  followed  closely  tho 
suggested  list. 

Method,  of  coding. — It  was  apparent  that  grade-slip  comments  could 
not  be  employed  individually  because  thcro  wero  too  many  different 
remarks  employed  (threo  to  four  hundred).  In  addition,  most  in¬ 
dividual  comments  were  too  rarely  used  to  yield  a  reliable  scoro.  Sinco 
it  seemed  probablo  that  the  bulk  of  tho  comments  could  bo  accounted 
for  in  terms  of  a  relatively  few  independent  factors,  tho  problem  bo- 
camo  one  of  combining  various  comments  into  categories  relatively 
homogeneous  internally  and  independent  of  ono  another.  Tho  first 
step  was  to  develop  an  81-itcm  codo  which  partly  on  tho  basis  of  asso¬ 
ciation  with  certain  maneuvers  and  partly  on  on  a  priori  basis  was 
regrouped  under  one  of  the  following  categories:  motor  technique,  per¬ 
ception,  motivation,  hcadwork  or  emotional  difficulties.  The  final 
code  was  developed  in  terms  of  a  breakdown  of  theso  items,  mado  in 
accordance  with  their  relation  to  graduation-elimination.  Tho  first 
10  categories  in  tnblo  5.11  arc  the  ones  which  were  formed  on  tho  basis 
of  the  findings  from  a  preliminary  study.  Tho  results  of  this  pre¬ 
liminary  study  arc  presented  in  tables  A5.1  and  A5.2  in  the  appendix. 

Tho  number  of  comments  under  each  code  or  category  was  divided 
by  tho  number  of  grade  slips  for  the  individual.  Thus  tho  final 
category  scoro  represented  the  average  number  of  comments  per  grado 
slip  for  a  given  category  of  comments. 

No  weighting  was  mado  of  the  comments  on  thv.  basis  of  content, 
intensity,  or  tho  letter  grado  which  it  accompanied. 

Results. — In  tabic  5.11  arc  presented  tho  results  of  this  later  study. 
These  data  indicated  that  the  category  scores  derived  from  grado  slip 
comments  offered  possible  differential  criteria,  tho  intcrcorrclations 
among  the  comments  wero  uot  as  high  ns  those  among  tho  letter  grades 
on  the  grado  slips. 

Tho  category  scores  predicted  success  in  Primary  pilot  training, 
tho  most  promising  yielding  a  correlation  of  over  0.40.  There  w'as 
considerable  variation,  however,  in  tho  size  of  tho  correlations  for  the 
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thrco  populations  studied.  All  of  these  correlations  arc,  of  course, 
somewhat  spuriously  high  since  tho  instructor  who  wrote  tho  com¬ 
ments  on  the  grade  slips  also  made  the  recommendation  that  tho  poor 
students  should  be  sent  up  for  elimination  check  rides  and  usually 
discussed  the  students  with  the  cheek  pilot  before  and  after  ho  flow 
with  them.  The  correlations  with  success  in  tho  next  phase  of  train¬ 
ing,  Basic,  arc  free  from  this  factor  and  arc  considerably  lower.  When 
the  result  of  the  three  populations  studied  arc  combined,  tho  highest 
correlations  with  success  in  Basic,  arc  in  the  neighborhood  of  0.25.  It 
will  be  remembered  that  tho  average  chcck-rido  grades  and  tho  pro¬ 
ficiency  card  ratings  in  Primary  also  were  found  to  have  about  this 
same  degree  of  relationship  to  success  in  Basic. 

Factor  analysis V — Intercorrclations  between  tho  grade  slips  cate¬ 
gory  scores,  Primary  check  ride,  selected  tests,  and  tho  pilot  stanino 
for  tho  November  1913  Aviation  Cadet  Classification  Battery  are 
given  in  tho  appendix  in  tablo  A5.3.  These  intercorrclations  were 
subjected  to  a  centroid  factor  analysis  and  11  rotated  factors  were 
isolated.  The  rotated  factor  loadings  arc  given  in  tablo  5.12  below. 
The  factors  which  they  isolated  were  described  by  their  in  tho  fol¬ 
lowing  way: 

Rotated  Factor  I:  The  pilot  stanino  was  included  in  tho  matrix  of 
variables  because  of  interest  in  discovering  tho  loadings  of  tho  stanino 
in  any  new  factors  which  might  be  discovered.  It  was  realized  that, 
in  general,  tho  practice  of  introducing  such  a  linearly  dependent 
variable  into  a  matrix  transforms  specific  and  error  varianco  into 
common  variance.  This  results,  theoretically,  in  tho  necessity  of 
extracting  an  additional  centroid  for  each  other  variable.  It  was 
believed,  however,  that  it  was  sufficient  for  tho  purposes  of  this  pre¬ 
liminary  study  to  have  but  one  factor  best  defined  by  tho  linearly 
dependent  variable.  Rotated  Factor  I  is  this  factor.  It  emerged 
very  clearly  in  tho  analysis. 

Rotated  Factor  II.— This  is  obvi&usly  a  “Ilalo”  Factor  and  has  no 
significant  loadings  for  any  variables  not  derived  from  tho  instructor's 
comments. 

Rotated  Factor  III. — Tliis  is  tho  Numerical  Factor  commonly 
found  in  analyses  of  tho  Classification  Battery. 

Rotated  Factor  IV.— This  factor  is  tho  Reasoning  Factor  found  in 
other  analyses. 

Rotated  Factor  V—  Spatial  Relations  Factor.  (Previously  iso¬ 
lated.) 

Rotated  Factor  VI. — Verbal  Factor.  (Previously  isolated.) 

Rotated  Factor  VII.— Perceptual  Factor.  (Previously  isolated.) 

Rotated  Factor  VIII. — Mechanical  Experience  Factor.  (Previously 
isolated.) 


u  ThU  factor  analysis  was  performed  by  I.t,  John  I.  I.at»»y  and  Sgt.  Harold  II.  Singer. 
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Tabu  3.11. — Intercorrelations  of  categories  of  primary  grade  slip  comments  and  their  relationship  to  measures  of  proficiency  in  basic 

Primary  Pilot  Classes  at  Stamford  and  Bonham 

(<4-n  <Jul.  43  Battery  N-1S8),  44-H  CSov.  43  Battery  y-!C9).  and  44-K  (Not.  4J  Battery  N-3IS)] 
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Tails  5.11. — InUr correlation*  of  categories  of  primary  grade  slip  comment e  and  their  relationehip  to  measures  of  proficiency  in  basic — Cont’d 

Primary  Pilot  Classes  at  Stamford  and  Bonham 
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Rotated  Factor  IX. — This  factor  has  not  been  isolated  in  previous 
analyses  and  has  been  tentatively  labeled  ns  the  Motor  Tenseness 
Factor.  It  is  interesting  to  note  that  tho  Rudder  Control  Test 
(CM120B)  has  the  highest  loading  for  any  test  on  this  factor  and 
also  has  its  own  highest  loading  on  tho  factor.  Also,  Primary  averngo 
check  ride  has  its  highest  loading  on  tho  Motor  Tenseness  Factor. 
The  factor  is  best  defined  by  tho  comments  in  tho  categories  of 
“Motor  Technique”  und  “Rough,  Abrupt,  or  Tenso  Uso  of  Controls.” 


Table  5.12. — Rotated  factor  loading*  of  grade  tlip  comment * 
(Based  on  intercorrelations  presented  in  tablo  A5.3) 


1 

II 

III 

IV 

V 

VI 

VII 

VIII 

IX 

X 

XI 

k  > 

1.  Motor  technlquc-grads 
and  dims  . 

03 

-01 

57 

01 

01 

00 

12 

01 

-04 

12 

45 

-A4 

-11 

-14 

50 

2.  Motor  tedinlquc-fTrads. 

48 

-03 

-03 

00 

-«i 

01 

09 

-04 

27 

3.  Motor  teihnlqiie-clims. 

-01 

63 

12 

03 

01 

14 

09 

14 

29 

05 

-04 

86 

4.  rcrccptlon-«rads  and 
dims  . 

—14 

52 

-10 

ID 

05 

07 

05 

-04 

20 

00 

07 

17 

39 

8.  Fcrerptlon-cllms . 

-02 

40 

10 

-0.1 

-10 

13 

16 

17 

33 

-07 

40 

6.  Mutivatlon-dims . 

17 

23 

00 

-04 

00 

-05 

00 

15 

17 

61 

-05 

62 

7.  lleadwork-crads  and 
dims  . 

-04 

52 

-10 

06 

29 

20 

-06 

04 

31 

-05 

07 

63 

8.  Ileadwork-cllms  ... 

07 

68 

05 

23 

19 

-04 

-04 

15 

26 

26 

16 

62 

0.  Emotional  dtlUcultlcs- 
dlms . 

00 

33 

03 

00 

16 

01 

00 

19 

03 

84 

11 

49 

10.  Itouch,  abrupt,  or 
tense  controls . 

01 

38 

-05 

02 

08 

06 

03 

05 

45 

15 

00 

40 

11.  Elementary  check* 
ride . 

12 

-08 

18 

18 

05 

03 

09 

42 

34 

00 

42 

12.  Biographical  data- 
navigator  . 

-07 

—06 

23 

-11 

-IS 

26 

13 

09 

14 

02 

16 

23 

13.  Biographical  data- 
pilot . 

23 

-02 

-07 

-12 

-11 

07 

14 

39 

10 

08 

II 

30 

14.  Spatial  orientation  I  . 

04 

-03 

-05 

02 

35 

12 

GS 

02 

II 

-05 

05 

63 

15.  SpotiAl  orientation  II 

10 

-01 

05 

21 

27 

II 

85 

14 

-01 

-02 

-07 

47 

19.  Bending  comprehen¬ 
sion . 

00 

-05 

20 

35 

21 

61 

-03 

01 

00 

-01 

01 

60 

17.  Dial  and  tabl#  read¬ 
ing  . 

00 

05 

44 

11 

40 

20 

31 

-15 

04 

-02 

II 

68 

18  Flncer  dexterity 

-11 

-11 

09 

-08 

37 

-08 

-04 

20 

05 

-09 

00 

24 

10.  Two-hand  coordina¬ 
tion  . 

00 

-02 

-00 

12 

86 

-15 

-10 

42 

-02 

06 

-10 

60 

20.  Dfscrl  mi  nation  reac¬ 
tion  time . . .  ... 

09 

-00 

IS 

11 

47 

06 

14 

-01 

12 

12 

17 

35 

21.  Complex  coordination 

20 

-02 

16 

-01 

57 

-04 

03 

21 

II 

-09 

16 

49 

22.  Mechanical  principles 

04 

-04 

00 

46 

25 

25 

10 

41 

12 

02 

-04 

84 

23.  Instrument  compre¬ 
hension  II . 

17 

04 

16 

03 

48 

20 

31 

no 

17 

00 

-10 

49 

24.  Oenernl  Information ... 

27 

-02 

00 

37 

12 

.19 

-01 

27 

12 

12 

-18 

80 

10 

02 

1 

30 

01 

—05 

18 

-14 

12 

-15 

01 

09 

28 

-09 

04 

19 

2rt.  Itotnry  pursuit . 

40 

01 

-05 

39 

00 

-09 

-II 

37 

27.  Mathematics  D . 

03 

00 

42 

43 

12 

39 

09 

00 

00 

00 

-01 

88 

28.  IMIotstanlne . 

03 

-02 

05 

13 

88 

17 

22 

83 

10 

-01 

14 

1.14 

Rotated  Factor  X. — This  is  another  new  factor  and  is  best  defined 
by  its  high  loadings  for  tho  Motivation  and  Emotional  Difficulties 
categories.  It  should  bo  noted  that  Primary,  averngo  check  rido  has 
its  second  highest  loading  on  this  factor  while  nono  of  tho  Classifica¬ 
tion  Tests  have  any  appreciable  loadings  on  it. 

Rotated  Factor  XI. — Residual  Factor. 

As  can  bo  seen  from  theso  results,  tho  uso  of  the  category  scores  in 
a  factor  analysis  appears  to  yield  a  possibility  of  new  insights  into 
the  nature  of  both  tho  over-all  pilot  criterion  and  tho  Classification 
Tests  themselves.  Apparently,  two  sizablo  independent  components 
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of  Primary  pilot  proficiency  have  been  i  sol  u ted  in  Rotated  Factors  IX 
and  X.  Classification  Tests  have  very  low  loadings  on  these  factors, 
so  those  factors  may  be  regarded  as  promising  areas  for  new  test 
development.  Since  proper  combinations  of  the  category  variables 
in  table  5.13  would  apparently  yield  relatively  homogeneous  measures 
of  the  Motor  Tenseness  and  Motivation  Factors,  these  combinations 
of  the  category  variables  should  be  used  ns  tho  criteria  against  which 
to  validate  and  refine  experimental  tests  designed  to  measure  tho  two 
new  factors. 

PILOT  RATING  SCALE,  FORM  C 

T1  ic  Pilot  Rating  Seale  was  developed  originally  in  tho  OfReo  of 
the  Air  Surgeon,  Ilq.  Army  Air  Forces,  to  provide  specific  criteria  of 
different  aspects  of  pilot  performance  for  use  in  validating  classifica¬ 
tion  tests.  The  items  for  the  scale  were  selected  after  an  analysis  of 
the  faculty  board  proceedings  for  1,000  cadets  who  failed  Primary 
pilot  training.  Tho  scale  passed  through  two  revisions,  and  a  largo 
number  of  students  were  rated  on  it. 

Correlation  with  stanines  and  Primary  pass-jail. — Table  5.13  presents 
tho  intcrcorrclations  between  instructors'  ratings  made  after  8-10 
hours  of  training,  pilot  stanines,  and  graduation-elimination.* 


Taiw.e  £.13. — Correlation  of  ratings  on  pilot  rating  scale  ( Form  C)  with  pilot  stanins 

and  with  primary  pass-fail 

(For  lPr.0  Cndots  Without  Previous  Fly  Inc  Etpcrlerwc  In  Clfus  43-C,  EFTCJ 
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It  can  bo  seen  from  theso  data  that  ratings  given  by  instructors 
after  S-10  hours  of  training  were  more  closely  related  to  graduation- 
elimination  in  primary  than  were  pilot  stanino  scores.  Howevor, 
consideration  should  be  given  the  fact  that  for  about  half  tho  climinces 
tho  ratings  were  made  at  the  tiino  of  their  elimination,  and  that  in  all 
cases  tho  ratings  wero  mado  by  tho  samo  instructors  who  wero  influ¬ 
ential  in  deciding  whether  or  not  a  student  should  bo  graduated  or 
eliminated. 

It  is  also  evident  that  tho  stanines  appeared  to  be  somewhat  more 
closely  related  to  graduation  than  they  wero  to  instructors'  ratings. 

Prediction  oj  perjormance  in  basic. — In  another  study  by  tho 
Psychological  Section,  Office  of  tho  Surgeon,  Ilq.,  AAF  Training  Com¬ 
mand,  ratings  made  in  primary  training  wero  correlated  with  thoso  in 
basic  for  435  students  in  class  43-D.  Tho  scores  used  for  this  cor- 

*  Thi  h>  tint*  were  imblbhrd  by  Ilq.  AFTAS  on  tb«  btsl*  of  rottcrltl  submitted  by  Psychologic*!  O*- 
tfArch  Unit  No.  I. 
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relation  were  the  sum  of  all  items  on  tho  Pilot  Rating  Scalo  (Form  C). 
The  results  arc  presented  in  tablo  5.14. 


Table  5.14. — Correlation*  of  rating t  on  pilot  rating  scale  ( Form  C)  at  primary  with 
pilot  alanine  and  with  ratings  at  basic 


• 

N 

M 

SD 

Condition 
with  tho 
bide  rat¬ 
ine  1 

First  primary  rating  t  . 

4.15 

SI  52 

Ba  ;  ^ 

0  ?5 

Fcconll  primary  ratine1 . 

lilt 

1*1.10 

gfi 

.3 

Pilot  Mi'nine.  ..  . 

4.15 

8  (M 

iSGLU 

.31 

Kiiml  rnliiiK  (nil  tws)t  . . .  „  . . 

415 

at.  yt 

'f'.lril 

Final  b.isic  rut  Ink  (only  cases  with  final  primary  rating) . 

3V1 

KS.  47 

s’* 

•  Sum  of  All  Hems  on  scale  n<lmlnlstcrc<l  at  8-10  hour*  ot  training. 

*  Sum  of  all  Items  on  scnlo  administered  at  graduation  or  elimination. 


Like  all  of  the  other  correlations  between  different  phases  of  train¬ 
ing,  the  cocflicicnts  aro  low.  Ratings  made  at  tho  8-10  hour  lovcl 
and  at  graduation  or  elimination  from  Primary  correlated  0.25  and 
0.33  respectively  with  those  made  at  graduation  or  elimination  from 
Basic. 

For  purposes  of  comparison,  the  correlation  of  the  pilot  stanino  with 
the  ratings  in  Basic  is  included  in  tablo  5.14.  It  can  be  seen  that  tho 
stonines,  which  were  based  upon  aptitude  tests  administered  prior  to 
entrance  into  preflight  training  gave  as  accurate  a  prediction  of  flying 
proficiency  in  Basic  as  did  instructors’  ratings  based  on  tho  whole 
course  oj  Primary  flying  training. 

Differential  criterion. — If  correlations  of  tests  with  measures  of 
specific  types  of  pilot  performance  were  available,  it  might  bo  possible 
to  identify  independent  aspects  of  flying  performance  ami  develop  im¬ 
proved  methods  of  predicting  each  of  them.  Psychological  Research 
Linit  No.  2  investigated  tho  possibility  of  using  the  Pilot  Rating  Scnlo 
in  this  manner. 

Intcrcorrelations  of  the  items  in  Form  A  of  the  Pilot  Rating  Scnlo 
were  computed  on  3G9  students  in  class  42-K  who  were  rated  between 
the  eighth  and  tenth  hours  of  Primary  training.  These  intercorrela¬ 
tions  nre  presented  in  table  A5.4  of  the  appendix.  They  wero  high. 
It  was  not  possible  to  determine  how  much  of  these  high  intercorrela¬ 
tions  was  due  to  “halo  cfTect”  and  how  much  was  tho  result  of  truo 
association  between  tho  variables. 

On  tho  basis  of  an  inspection  of  tho  intcicorrelations,  the  items  wero 
arranged  into  clusters,  shown  with  their  intercorrelations  in  tablo  5.15# 

In  general  tho  intercorrelation  among  clusters  of  items  is  fairly  high 
being  somewhat  lower  with  items  in  Cluster  VI  (Attitude). 

In  tablo  5.16  are  presented  tho  correlations  of  tho  Pilot  Rating 
Seale  (form  C)  with  Primary  pass  fail.  From  this  table  it  is  apparent 
that  all  tho  items  on  the  rating  scale  show  a  substantial  correlation 
with  pass  fail  in  Primary  school.  This  is  not  surprising  sinco  tho  in-  * 
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structor  who  made  the  ratings  also  played  an  important  role  in  de¬ 
termining  whether  the  student  passed  or  failed  and  since  a  number  of 
the  ratings  were  made  after  the  instructor  knew  that  his  student  had 
been  eliminated.  It  may  be  noted  that  the  averngo  correlations  of 
items  in  Cluster  I  (Ileadwork),  and  II  (Perception)  arc  greater  than 
those  of  the  other  clusters.  Cluster  VI  (Attitude)  showed  the  lowest 
predictive  efficiency. 

Conclusions. — Ratings  made  in  Primary  flying  training  did  not  pre¬ 
dict  subsequent  success  in  Basic  any  better  than  did  stanines  based  on 
aptitude  tests  given  before  tho  student  entered  preflight  training. 
Ratings  on  the  individual  items  showed  high  intercorrclations,  in¬ 
dicative  of  considerable  “halo  effect”  and  these  characteristics  made 
this  scale  of  little  use  ns  a  source  of  differential  criteria.  On  tho  basis 
of  these  facts  it  was  decided  to  discontinue  work  on  tho  Pilot  Rating 
Scale. 


Taulk  5.15. —  Average  intcrcorrelation  among  clusters  of  Hems  on  pilot  rating  scale 

(form  A) 

(Rased  on  3C9  student?  In  elnsi  42-K  rated  between  the  8th  and  10th  boun  of  primary  training] 


I 

II 

in 

IV 

a 

VI 

Cln«lrr  1  (Handwork)1 . 

Cluster  II  (I’crccptlon) . 

Cluster  III  (Orhntntlon) . 

Cluster  IV  (Coordination) . 

Cluster  V  (Kindlon)  . 

Cluster  VI  (Attitude) . . 

5SSSS5 

O  j 

. p 

ssssas 

OH 

.42 

% 

.41 

.39 

ft  49 
.48 
.47 
.78 
.40 
.39 

aro 

.44 

.41 

.40 

.72 

.48 

a<# 

.40 

.30 

.39 

.48 

.81 

•  Tlir  no\t  table.  5  it'.,  give*  the  IK  of  items  Included  In  each  duster  and  Anpendli  tnble  A4.4  Rive*  tha 
eomi  l.  te  nmtrh  cl  IntercvrreLitlon?  from  which  the  within  cluster  (e.  f I  r.  I)  and  betwcen-cluster  («.  g. 
If.  II)  averntiej  were  computed. 

i  Since  there  was  only  uuo  Item  In  thU  cluster,  no  wtthln-clustcr  correlation  could  be  computed. 


INVESTIGATION  OF  PILOT  TRANSITION  TRAINING  RECORD 

Tho  Pilot  Project 19  investigated  tho  Transition  Training  Record 
which  was  available  in  four-engine  schools,  for  possible  use  as  a  source 
of  proficiency  data  to  employ  in  selecting  lead-crew  pilots,  as  a  cri¬ 
terion  against  which  to  evaluate  classification  tests,  and  os  a  guido  in 
the  construction  of  objective  measures  of  flying  skill.  The  pilot  Transi¬ 
tion  Training  Record  was  made  up  of  nine  major  divisions  designed  to 
include  all  phases  of  transition  training:  day  transition,  night  transi¬ 
tion,  instrument  flying,  formation  flying,  altitude  flying,  day  naviga- 
tioi  night  navigation,  additional  flying  instruction,  and  ground 
instruction.  Each  major  section  was  subdivided  into  items  ns  illus¬ 
trated  below: 

Formation  Flying: 

a.  Assembly  from  single  piano  tnkc-off. 

b.  Relative  position  in  3-plano  V. 

Straight  and  level. 

Turns— 10°,  20°,  and  30°  bank. 

*  *  Moit  of  tlilt  work  was  don*  by  Pgt.  John  R.  Rohrs. 
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c.  Relative  position  in  3-plnnc  echelon. 

Straight  and  level. 

Turn-away  from  echelon. 

d.  Landing 

Assuming  proper  spacing  from  3-plano. 

V  and  echelon. 

In  all  there  were  102  such  items.  On  each  item  tho  students  wero 
rated  by  their  instructors  on  a  three-category  scalo:  “good/'  “fair," 
and  “poor."  For  tho  purposes  of  this  study  only  tho  82  items  wero 
used  which  were  rated  on  at  least  90  percent  of  tho  transition  records. 

In  order  to  have  a  criterion  against  which  to  evaluato  tho  transition 
record,  the  supervisory  personnel  in  each  squadron  of  the  school  wero 
asked  to  divide  their  students  into  tho  best  quarter,  tho  second  best 
quarter,  the  third  best  quarter,  and  the  poorest  quarter.  Ratings  by 
the  supervisory  personnel  wero  based  on  an  analysis  of  tho  daily  grado 
slips  and  conferences  with  the  instructors. 

Table  5.16. — Correlation  of  items  on  pilot  rating  scale  form  C  xrith  primary  past- 

fail  1 


Class  44-A  N»=>487  P,=.7I 

Class  44- B  N,=090  P,=.7fl 


Class  44-A 

Class  41 -D 

Key 

Ms 

M. 

B3 

rwt 

V. 

m 

D 

1.  Judgment  (!)•  . 

4.34 

2.97 

1.17 

o  to 

4  IS 

2.07 

1.03 

0.07 

a  os 

1 

2.  Korcsh’ht  nn  1  planning  (I) . 

4.23 

2.KS 

1.20 

.09 

4.03 
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1  US 

.CO 

.64 

3 

3  Memory  0)  . 

4  4A 

3.00 

1.24 

.CM 

4  32 

3. 01 

1.17 

.04 

.08 

3 

4  Comprehension  (1)  . 

4.49 

3.21 

1.13 

.06 

4  40 

3.47 

1  00 

.S3 

.39 

4 

3.  Vi.cialltVIonof  courre  (1)  . 

fl.  Kst  Inn' Ion  of  speed  amt  distance  (1). 

4.  19 

2.79 

1.19 

.71 

4.  II 

2.97 

1  09 

.01 

.08 

5 

4  IS 

2.92 

1.18 

.04 

4.07 

2.09 

I.0S 

.81 

.03 

e 

7.  l-'eiiseofxustenla'lon  (It)  . 

4  2H 

2.  OS 

1.  IS 

.71 

4  IS 

2. 9S 

1. 12 

.01 

.08 

7 

*.  Division  of  attention  (1)  . 

4.  19 

2.91 

1.  19 

.03 

4  Ol 

2. 09 

1.  10 

.38 

.00 

• 

9  Orientation  (III)  . . 

4.33 

3  4S 

1.0S 

•  SO 

4  ?S 

3.4S 

1  (7 

.30 

.to 

9 

to.  Steed  of  decision  nnd  reaction  tl).. 

4.  17 

02 

1.  17 

.05 

4  P4 

2  09 

I.  OS 

.87 

.01 

10 

It.  Coordltmtlen  (IV)  .  . . 

13.  Appropriateness  of  rout  rob  wed 

4.11 

3.12 

1  C9 

.02 

4  10 

3. 18 

1.00 

.34 

.38 

II 

(IV)  . 

431 

3  11 

1  07 

.08 

4  18 

3  38 

0  01 

.SO 

.09 

13 

13.  Keel  of  controls  (II)  . 

4.2S 

2  IK 

1.  14 

.70 

4  12 

3. 1)7 

1.  10 

.01 

.08 

13 
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.73 

4.09 
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.04 

.69 

13 

in.  Absence  oflonsrncss  (V)  . 

17.  Absence  of  roiifiLdon  and  nervous- 

4.  y. 

3  30 

1. 22 

.59 

4.37 

2.37 

1.  13 

.42 

.38 

14 

ness  (V)  . . 

IS.  Atremc  of  fear  and  appicheuslon 

i  $4 

3.33 

1.  17 

.Cl 

4  41 

3.41 
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.44 

.57 

17 

(V)  . 

4  M 
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1.  II 

.31 

4.  os 
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.43 

.to 

IS 
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1.  II 

.31 

4  73 

3.  PJ 

1.01 

.47 

.31 

19 

20  VotluiHon  ami  uttitmte  (VI)  . 

S.  IS 

4.41 

1.  10 

.41 

3  OS 

4  39 

1.00 

.41 

.41 
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21.  Probable  sneeras  . . 

4.  SO 

2.99 
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.78 

4. 38 

3. 07 

1.  II 
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•  Students  were  rntod  on  the  Mot  Ttatlnc  Fenle  between  ttie  fourth  and  twentieth  hours  of  rrlinnry  train- 
Ins.  The  ratines  and  pass-fall  were  not  In  h  j»  mb  nt  measures  since  the  Instructors  who  made  tl'.c  ratlm.’* 
also  played  nn  ltnt«>rlnnt  role  In  «li lerinlnlue  whether  or  not  the  sticTnit  was  pa  <ed  or  failed;  futtbumore, 
a  nnmlxr  of  the  ratines  were  made  after  the  Imuuctur  knew  that  his  student  had  been  eliminated, 

•  Key  to  cluster  In  w  hlch  each  Item  was  Included; 

I-lhadwork  IV -Coordination 

H-lYrrrplInn  V-  Kinotlon 
Ill-Orlentatlon  VI-Attltuda 

•  r.-Averajc  correlations  for  both  samples  obtained  through  Fisher's  » transformation  technique 

A  total  score  for  the  transition  record  was  secured  by  assigning  a 
weight  of  plus  1  to  a  rating  of  “good,"  zero  to  “fair,"  and  minus  1  to 
“poor."  The  weights  on  all  items  wero  algebraically  summed.  For 
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237  students  in  classes  44-E  and  F  the  correlation  between  this  total 
score  of  the  Transition  Record  and  tho  squadron  rankings  was  only 
0.3 1.30  It  was  not  possible  for  both  of  these  measures  to  bo  good, 
since  the  correlation  between  them  was  low. 

On  the  assumption  that  the  better  of  these  measures  would  bo  moro 
likely  to  correlate  with  other  factors,  tho  rclationsh'p  between  each  of 
them  and  the  unaugmented  pilot  stanino  was  determined.  For  181 
students  the  correlation  between  the  transition  records  and  tho  sta- 
ninc  was  only  0.01.  For  177  students  the  correlation  between  squad¬ 
ron  ranking  and  pilot  staninc  was  0.21.  The  difference  between  these 
correlations  is  significant  at  the  2-percent  level.*1  On  the  assumption 
that  more  reliable  and  valid  measures  of  proficiency  will  have  higher 
correlations  with  other  variables,  one  may  conclude  that  tho  squadron 
rankings  arc  better  than  tho  Transition  training  records. 

Finally,  two  item  analyses  were  made  of  the  Transition  training 
records.  The  first  of  these  was  on  the  basis  of  the  upper  nnd  lower  27 
percent  of  the  Transition  records  rank-ordered  by  composite  score  and 
the  second  was  on  the  basis  of  the  highest  and  lowest  quarters  separated 
according  to  the  ratings  of  the  supervisory  personnel.  Discrimina¬ 
tory  differences  between  the  items  were  similar  for  both  analyses  and 
the  grouping  of  the  items  clearly  showed  that  there  was  so  much 
“halo  effect”  that  an  item  analysis  could  not  be  of  much  value.  Fur¬ 
thermore,  the  grade  of  “poor”  occurred  so  rarely  that  tho  rating  was 
in  effect  reduced  to  the  dichotomy  of  “good”  nnd  “fair.”  A  total 
score  was  obtained  by  rescoring  tho  Transition  records  on  tho  basis  of 
tho  twenty  most  discriminating  items  from  the  analysis  against 
supervisors’  rankings,  but  the  correlation  between  this  refined  score 
nnd  the  pilot  stnninc  was  only  0.07  which  is  not  reliably  different  from 
the  results  obtained  by  using  the  original  scoro. 

On  the  basis  of  these  results  it  was  decided  that  tho  Pilot  Transition 
Training  Record  was  not  a  useful  mcasuro  of  proficiency. 

SUMMARY 

In  general,  tho  correlations  among  subjcctivo  grades  for  different 
aspects  of  flying  were  high  indicating  the  probable  presence  of  a  strong 
halo  effect.  Theso  high  correlations  limited  tho  possibility  of  using 
tho  various  grades  differentially,  cither  in  selecting  students  for  differ¬ 
ent  types  of  specialized  training  or  ns  specific  criteria  for  tho  separato 
validation  for  the  different  types  of  nptitudo  tests.  Tho  intcrcorrcla- 
tions  among  scores  derived  from  instructors’  comments  on  student 
errors  wero  considerably  lower  so  that  it  seemed  that  thcro  would  bo 

m  All  coi  relation*  Involvln*  the  sui'erel*or*‘  dlvl  lon  of  tho  rl.v *  Into  quarter*  were  corrected  for  brood 
mirror!  e*  for  •  rectinmW  ilbtrlbutlun  by  table  No.  33.  p.  303  of  Tetm  end  Van  VoorhU,  Stalls  leal 
Prot/Jurti  tnjlktir  Malknrulkol 

•>  Compute!  by  the  formula  for  the  difference  between  correlation*  from  the  same  or  correlated  populv 
tlons,  K.  V.  UndqulJl,  Stotittkal  Antlfilt  In  Mutation* f  Pttttnk,  p.  313, 
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some  possibility  of  getting  more  specific  measures  of  different  Aspects 
of  flying  performnneo  by  developing  a  check-list  of  common  errors. 
This  was  supported  by  tho  fact  that  factor  analyses  of  scores  derived 
from  the  comments  isolated  several  independent  factors.  Somo  of 
these  were  predicted  by  tho  present  battery  of  classification  tests  and 
others  were  not  predicted,  therefore  suggesting  areas  in  which  new 
tests  should  bo  developed. 

Within  the  same  school,  successive  grades  by  instructors  and  check 
riders  were  not  made  independently;  tho  rater  almost  always  took 
previous  grades  into  account  before  arriving  at  a  final  decision. 
Thus  the  correlations  between  such  grades  wero  spuriously  high. 
When  grades  given  at  ono  school  were  compared  with  thoso  at  tho 
next  more  advanced  school,  tho  evaluations  wero  relatively  independ¬ 
ent.  Under  these  conditions  tho  correlations  wero  low,  in  tho  rango 
of  0.20  to  0.35.  In  fact,  grndes  based  upon  tho  wholo  courso  of 
Primary  flying  instruction  did  not  predict  grades  at  tho  Basic  lovcl 
any  better  than  did  aptitude  tests  administered  before  tho  student 
entered  preflight  training.  Tho  unreliability  of  tho  subjectivo  flying 
grades  probably  was  one  of  the  factors  causing  the  correlations  between 
grades  at  different  levels  of  training  to  bo  sojow^l  It  is  also  possiblo 
that  students  who  were  slow'  to  catch  on  at  first  did  better  in  later 
stages  of  training;  that  a  different  level  of  training  demanded  different 
abilities  from  tho  students;  or  that  somo  students  changed  their 
motivation  or  attitude.  Whatever  tho  reason  for  theso  low  correla¬ 
tions,  tho  fact  that  the  grades  at  ono  level  of  training  did  not  predict 
thoso  at  tho  next  lovel  is  of  considerable  practical  importance  in  that 
it  suggests  that  a  number  of  students  eliminated  in  Primary  might 
havo  received  satisfactory  grades  if  they  had  been  allowed  to  proccod 
to  Basic. 
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CHAPTER  SIX 


Objective  Measures  of  Flying 
Skill  for  the  Primary  Level 
of  Pilot  Training 

Cnpt.  Richard  P.  Youtz”  . 


INTRODUCTION 

Importance  of  Research  at  the  Primary  Level 

Primary  school  was  a  crucial  phaso  of  pilot  training.  In  Primary 
most  students  received  their  first  flying  instruction,  bccamo  familiar 
with  the  fundamental  maneuvers  of  flight,  and  exhibited  their  aptitudo 
or  lack  of  it.  Of  elimination  for  lack  of  flying  proficiency  in  Primary, 
Basic,  and  Advanced  schools,  considerably  moro  than  half  occurred 
at  the  Primary  level.  Definite  objcctivo  standards  were  particularly 
desirable  in  Primary  to  select  thoso  students  whoso  skill  warranted 
further  training  and  to  eliminate  early  thoso  students  who  would  not 
be  nblo  to  meet  tho  high  proficiency  requirements  of  combat  flying. 
For  these  reasons  tho  Primary  phase  was  chosen  for  intensive  inves¬ 
tigation. 

The  Primary  School  Curriculum 

Tho  maneuvers  it  was  possiblo  to  measure  in  Primary  schools  wero 
fairly  well  defined  by  tho  curriculum  and  customary  practices  of  tho 
schools.  Because  these  measures  of  flying  skill  wero  designed  for  uso 
with  the  regular  Primary  curriculum,  it  was  decided  to  confino  tho 
measures  devised  to  thoso  maneuvers  regularly  taught  at  Primary 
school.  If  measures  had  been  tried  out  on  maneuvers  which  were  not 
taught  at  Primary  schools,  tho  data  would  not  have  been  applicablo 
to  any  later  student  population  which  was  routinely  taught  theso 
maneuvers.  In  tho  first  experimental  investigation  of  measures  of 
flying  skill  at  a  Primary  school,  ono  maneuver  was  measured  which  tho 

n  Of  the  term  studies  completed  on  objective  measures  (it  the  Primary  lev*-!  for  which  the  writer  »u 
responsible,  the  follow  Inf  people  pwtlelpatcd  In  the  planning  and  esecutlon  of  the  field  trips:  Pgt.  M.  F. 
Connery  In  all  icven;  I.t.  J.  F.  Karnmnn  In  Pt miles  I,  II,  wl  III;  Sgt.  I.  It.  Rohrs  tn  Study  V ;  hgt.  1. 1. 
Wacltcrmann  In  Study  VI;  and  P/Pgt.  W.  W.  Ismael  In  Study  VII.  I.t.  R.  K.  ShowaUer  lU^rVUcd  Its* 

test  administration  In  Study  VI  and  had  charge  of  the  field  trips  In  Ftudles  IV  and  V. 

The  MAtl'tleiU  work  on  these  studies  w  as  done  by  Lt.  I.  F.  Ktmnitn,  Fgt.  J.  R.  Rohrs,  and  Fgt.  i.  J. 
Waellcrinann  under  the  technical  supervision  of  Lt.  J.  K.  Hemphill  and  T/fgt.  W  .  (I.  Matheny.  S/Ngt. 
C.  P.  Oershravn  supervised  the  statistical  analysis  of  the  data  In  Study  VII,  the  Prlmvy  section  of  whUh 
Involved  I.IU)  eve*.  Valuable  avis  tone*  and  advle*  were  received  from  Prof.  Phillip  J.  Hulon,  Acting  Dean 
of  the  Graduate  School  of  F.ducatlon,  Harvard  University. 
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students  had  not  previously  practiced.  It  was  found  that  largo  prac¬ 
tice  effects  wore  present  which  radically  changed  the  discriminating 
power  of  the  measures  from  tho  first  to  tho  second  administration. 
Tho  decision  to  avoid  maneuvers  not  regularly  taught  did  not  exclude 
tho  use  of  new  and  ingenious  methods  of  measuring  manuo/ers  that 
students  had  already  practiced,  nor  did  it  prevent  the  tester  from 
measuring  parts  of  maneuvers  separate  from  tho  wholo  maneuver;  it 
did  mean  that  a  careful  examination  of  tho  curriculum  and  practices 
of  Primary  schools  was  necessary  in  making  up  measures  of  flying 
ability  for  administration  at  this  love  l. 

While  tho  curriculum  varied  slightly  from  school  to  school,  the 
fundamental  elements  remained  tho  samo.  Tablo  6.1  was  made  up 
after  examination  of  tho  curricula  of  threo  Primary  schools  and  shows 
tho  maucuvcrs  introduced  during  each  successive  week  of  training 
together  with  tho  number  of  hours  completed  by  tho  end  of  each  week. 
Tho  name  of  tho  maneuver  is  followed  by  a  footnoto  reference  when 
personnel  of  tho  Pilot  Project  devised,  tried  out,  and  used  or  discarded 
one  or  moro  measures  for  that  particular  maneuver.  It  will  bo  noticed 
that  almost  all  of  the  maneuvers  before  solo  were  mensurod.  This  was 


Table  0.1. — New  maneuvere  introduced  during  eaeh  week  of  primary  training 


Week 

No. 

Flying 
hours  at  end 
ol  weak 

New  maneuver*  Introduced  during  week 

1 

4 

Straight  and  level,'  use  of  trim  tabs '  gentle  •  and  medium  1  turns,  effect  of  torque,' 
climbs.'  climbing  turn*,'  glide*,'  gliding  turns,'  tailing,  rectangular  courses,' 
8  turns.' 

1 

1 

Coordination  eterclscs.'  stalls,'  spins  'and  spin  recovery forced  landing,'  takeoffs,' 
landings.'  wheel  landings,  crab  1  and  slip  *  on  Onal  approach,  crosswind  landings,' 
sleep  turns'  trnfllc  pattern,'  recovery  from  bounce  landings,'  recovery  from 
toom  landings,'  drift-correction.' 

S 

14 

Stall*  ami  spins  from  unusual  positions,  control-timing  excrciso  (supervised  solo 
takes  most  of  time  during  this  week). 

4 

72 

90*  areurncy  approach,'  elementary  8's,  ruddcr-eicrclse  stalls,'  chandollet. 

• 

30 

ICO*  side  approach. 

• 

39 

Loops,'  nylon  B’s,  laxy-S's,  300*  overhead  approach. 

llulf-rolls,  snap-rolls,  slow-rolls,  power-on  approaches  with  maximum  performtnoa 
power  glide. 

T 

45 

• 

57 

Tmincltnnnn  turns.'  half-roll  with  roll-out  reconrF. 

•  a  to 

(A 

Itovlow  of  all  previous  maneuvers. 

>  Maneuvers  os s  /blch  one  or  more  objective  measure*  hire  been  devised,  tried  out,  and  used  or  discarded. 


Fioone  0.1. — Percent  of  elimination t  occurring  at  tuccettive  Jive-hour  intervale 
during  training  in  primary  tchoolt 1 


flour  levil 

Percent  of 
ellmltK-c* 

Hour  level 

Percent  of 
fllmlnees 

1-5 . 

0 

35-40 . 

7.5 

0-10 . 

10 

41-45 . 

5.5 

11-15 . 

31 

40-50 . 

5 

10-20 . 

11 

51-55 . 

2.5 

21-25 . 

7 

50-00 . 

3 

20-30 . 

7 

01-05 . . 

2.5 

31-35 . 

7.5 

I  Number  of  iludcstiellmlnatcd-Mi;  Clwci  45  B,  0,  A  D,  AAF  Central  Flying  Training  Command. 
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true  because  later  maneuvers  tend  to  bo  mado  up  of  combinations  of 
earlier,  more  fundamental  maneuvers.  Work  was  concentrated  in  tho 
early  part  of  Primary  training  bccauso  most  of  tho  eliminations 
occurred  during  that  tirno. 

Hours  to  Elimination  in  Primary  School 

Tho  number  of  hours  of  flying  training  at  which  most  eliminations 
occur  is  important  in  tho  development  of  a  check-rido  for  use  in 
Primary  schools.  If  objective  measures  of  flying  skill  aro  to  bo  usoful 
in  standardizing  the  elimination  of  students,  tho  measures  used  must 
bo  applicable  at  tho  stago  of  training  at  which  tho  greatest  number  of 
eliminations  occur.  Only  then  can  objcctivo  measures  bo  used  to  sot 
standards  of  elimination.  In  validating  objcctivo  measures  against 
tho  graduation-elimination  criterion,  it  is  of  courso  also  dcsirablo  to 
administer  tho  measures  beforo  tho  bulk  of  tho  eliminations  occur  in 
order  to  avoid  restriction  of  rango.  Figure  6.1  shows  tho  percent 
of  eliminations  occurring  at  successive  5-liour  intervals  during  training 
in  Primary  schools  in  tho  Central  Flying  Training  Command  in 
classes  45-B,  45-C,  and  45-D,  combined.  Thero  wero  855  students 
eliminated  and  tho  figures  shown  aro  percents  of  theso  855  elimi¬ 
nations. 

From  figure  6.1  it  can  bo  seen  that  41  percent  of  tho  eliminations 
occurred  before  the  fifteenth  hour  and  66  percent  of  tho  eliminations 
occurred  by  the  thirtieth  hour.  It  was  desirable,  therefore,  to  test 
tho  students  as  early  as  possible,  but  not  so  early  that  tlioy  had 
not  had  an  opportunity  to  practico  a  representative  satnplo  of  tho 
basic  maneuvers  taught  in  Primary  school.  Tablo  6.1,  showing  the 
week  and  hour  of  introduction  of  new  maneuvers,  indicates  that  most 
of  tho  fundamental  maneuvers  hnvo  been  introduced  before  tho  four¬ 
teenth  hour.  An  attempt  was  mado  to  concentrate  most  of  the  work 
at  a  period  which  was  lato  enough  so  that  tho  students  would  have 
practiced  enough  maneuvers  to  afford  a  representative  snmplo  of  tho 
fundamental  elements  of  flying  skill,  and  early  enough  in  order  to 
include  ns  many  potential  climinccs  as  possiblo.  Theso  considerations 
placed  tho  ideal  time  for  research  at  approximately  tho  8-12  hour 
level,  when  tho  students  were  just  beginning  to  solo. 

STEPS  IN  THE  DEVELOPMENT  OF  OBJECTIVE  MEASURES 

In  this  now  field  of  objcctivo  measurement  of  flying  skill,  a  number 
of  stops  were  necessary  to  develop  relevant  and  meaningful  measures. 
Throughout  tho  development  of  each  measure  this  Project  benefited 
by  the  advico  and  cooperation  of  tho  members  of  tho  Primary  Training 
Advisory  Board.  This  organization  was  attached  to  tho  AAF  Central 
Instructors  School  (Pilot)  and  had  responsibility  for  tho  supervision 
of  tho  Standardization  Boards  of  Eastern,  Western,  and  Central 
Flying  Training  Commands.  Its  members  also  made  rccommcnda- 
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tions  for  tho  changes  in  tho  Primary  school  curriculum  and  wcro 
responsible  for  tho  contents  of  tho  Primaiy  Flying  Manuals  used  by 
students  and  instructors.** 

In  attempting  to  devise  objcctivo  measures  applicable  to  this  now 
area  of  flying  skill,  tho  procedure  was  first  to  choose  for  analysis  an 
important  aspect  of  flying  skill  in  confcrcaco  with  tho  Primary  Train¬ 
ing  Advisory  Board,  then  to  prepare  preliminary  record  forms  for 
theso  measures  and  to  try  them  out  in  flight.  In  practice  this  meant 
that  pilots  from  tho  Primary  Board  and  personnel  from  this  Project 
alternately  performed  maneuvers  and  recorded  measures  of  these 
maneuvers  in  an  attempt  to  achicvo  tho  most  effective  form  of  meas¬ 
urement. 

After  theso  preliminary  trials,  tho  items  wcro  taken  when  possible 
to  a  nearby  Primary  school  and  a  few  students  tested  with  tho  meas¬ 
ures  to  make  suro  that  tho  administrative  instructions  wcro  clear  and 
tho  measures  really  flyable  by  students  at  that  lovcl.  Tho  meas¬ 
ures  were  then  tried  out  on  approximately  90  students  who  wore  divid¬ 
ed  into  criterion  groups  for  a  first  rough  determination  of  validity  and 
with  a  retest  administration  for  determining  reliability.  Alter  each 
mcasuro  was  tried  out,  it  was  frequently  necessary  to  mako  further 
changes  as  a  result  of  tho  experience  gained.  Many  measures  were 
eliminated  in  tho  preliminary  trial  stage  and  in  conference  with  tho 
Primary  Board  bccauso  objcctivo  measurement  of  a  particular  aspect 
of  a  maneuver  was  not  possible.  This  was  duo  to  tho  fact  that 
necessary  special  recording  equipment  was  not  available  in  the 
primery  trainer,  or  bccauso  tho  particular  measure  was  too 
susccptiblo  to  tho  effects  of  differences  between  planes  or  changes  in 
flying  conditions.  The  stages  in  tho  development  of  a  typical  measure 
aro  illustrated  below. 

Example  of  Stages  in  the  Development  of  it  Typical  Measure 

In  tho  initial  analysis  of  tho  critical  aspects  of  flying  skill,  it  was 
decided  in  cooperation  with  the  Primary  Board  tliat,  in  most  maneu¬ 
vers,  maintaining  a  constant  altitude  is  an  important  aspect  of  flying 
skill.  All  Primary  trainers  wcro  equipped  with  a  sensitive  altimeter. 
Furthermore,  maintaining  a  constant  altitudo  was  not  greatly  affected 
by  turbulcnco,  and  piano  and  engine  differences  entered  into  this 
factor  hardly  at  all.  Of  tho  many  maneuvers  in  which  altitude 
control -can  bo  measured,  tho  360°  steep  turn  seemed  likely  to  provido 
a  distribution  of  abilities,  since  it  is  moro  difficult  to  maintain  a 
constant  altitude  when  tho  piano  is  banked  steeply  in  a  turn  than  in 
lovel  flight. 

In  order  to  crystallizo  tho  discussion  on  essentia!  flying  skills,  forms 

■  Tho  member*  of  th*  Primary  Board  who  worked  wUh  thU  Project  or*  Major*  Chester  Brown,  Chair, 
man.  John  K.  Bowen,  Uarry  II.  Culler,  and  V.  C.  Denton,  and  Captains  Kart  D.  Caton,  and  Philip  B. 
Lockwood. 
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were  made  for  each  of  tho  measures,  showing  tho  ability  to  bo  meas¬ 
ured,  tho  task  to  bo  performed,  tho  mcasuro  to  bo  recorded,  tho  con¬ 
ditions  under  which  the  maneuver  was  to  bo  performed,  and  a  briof 
statement  of  procedures.  The  following  form  is  *or  altitude  control 
in  .a  3G0°  steep  turn. 

Form  1 

Aiulitt:  To  maintain  a  given  altitude  in  a  steep  300*  turn. 

Task:  To  execute  a  steep  300*  turn. 

Measure;  Amount  of  altitude  gained  or  lost.  Timo  in  seconds  to  complete 
turn  (as  a  measure  of  rate  of  turn  and  therefore  of  bank;  a  control 
condition  to  insure  that  the  student  banks  as  steeply  as  his  power 
setting  will  allow). 

Conditions:  Cruising  throttle  (r.  p.  m.  2100  In  the  Fairchild  Primary  Trainer, 
PT-19)  throughout  turn.  Altitude,  3,000  feet. 

Procedure:  The  administrator  takes  the  plane  up  to  3,000  feet  and  turns  it  over 
to  the  student,  instructing  him  to  cxccuto  a  steep  3G0*  turn 
leaving  the  throttle  at  endsing.  Ho  records  tho  amount  of 
altitude  gained  or  lost  and  the  timo  in  seconds  from  tho  beginning 
of  roll-in  to  the  end  of  roll-out. 

It  will  bo  noted  that  in  tho  Conditions  the  throttle  setting  is  "cruis¬ 
ing,"  which  would  give  an  r.  p.  m.  of  2100  in  tho  cruising  attitudes. 
Under  Measures,  altitudo  is  measured  but  also  tho  Time  in  seconds  to 
complete  the  turn.  Sinco  tho  Primary  trainer  has  no  artificial  horizon 
by  which  bank  can  bo  measured  and  has  no  ratc-of-tum  indicator, 
it  was  necessary  to  get  some  such  means  to  forco  tho  student  to  bank 
tho  piano  up  sharply.  It  was  not  practicable  to  mcasuro  tho  angle 
of  bank  in  terms  of  reference  points  on  the  plane,  sinco  tho  piano  in 
uso  at  that  timo  was  tho  PT-19  (Fairchild),  a  low-wing  monoplane 
with  no  very  good  reference  points  for  exactly  determining  tho  angle 
of  bank.  Tho  student’s  task,  then,  was  to  complete  tho  turn  as  rapidly 
as  possiblo  and  to  maintain  altitudo  throughout  tho  turn.  This  was 
difficult  because  if  tho  student  tried  to  turn  too  quickly,  his  bank 
would  bo  so  great  that  tho  amount  of  power  available  would  not  allow 
him  to  maintain  altitudo.  Nevertheless,  ho  had  to  bank  tho  piano  as 
sharply  as  possiblo  in  order  to  turn  rapidly. 

This  is  a  good  example  of  ono  problem  met  in  developing  objective 
measures  of  flying  skill.  It  is  frequently  necessary  to  mcasuro 
soveral  aspects  of  a  maneuver  in  order  to  bo  suro  that  various  condi¬ 
tions  of  a  maneuver  aro  fulfilled  without  which  the  measurement  of  tho 
critical  aspect  is  meaningless.  Without  somo  mcasuro  of  rato  of  turn 
or  bank,  tho  student  would  in  tho  extreme  enso  bo  ablo  to  uso  a  gcntlo 
or  medium  bank  and  hold  his  altitudo  much  moro  easily.  This  would 
reduce  tho  distribution  of  scores  on  tho  mcasuro  and  possibly  nmko  it 
worthless. 

During  preliminary  flight  testing  it  was  found  that  cruising  throttle 
did  not  allow  a  steep  enough  bank,  so  tho  condition  of  full-open 
throttle  was  added  as  shown  in  form  2. 
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Form  2 

Level  Turns  (300*) 


Tlroa 

Altltod* 

Over- til 

Stiffing 

nighMt 

LoWMt 

•valuation  • 

Left... 

At  cruiting  rpm 

see. 

. ft. 

. ft. 

. ft. 

4-3-2- 1 

Right. 

flee. 

. ft. 

. ft. 

. ft. 

4-3-2- 1 

Left... 

Atfull-optn  throttU 

see. 

. ft. 

. ft. 

. ft. 

4-3-2- 1 

Right. 

see. 

. ft. 

. ft. 

. ft. 

• 

4-3-2- 1 

1  rcrform&ncc  gralcd  on  4-polnt  tcala,  4  being  high. 


An  lysis . . . . . . . . . 

of 

Errors . . . . 

In  this  second  form  of  the  measure,  it  will  bo  noted  that  on  over-all 
evaluation  has  been  added  as  well  as  the  full-open  throttlo  condition. 
Spaco  is  also  provided  for  a  description  of  the  errors  not  objectively 
measured.  This  was  dono  so  that  if  the  subjcctivo  over-all  ovaluatioa 
did  not  agreo  with  the  objective  measures  used,  new  objective  measures 
could  bo  added  or  new  conditions  devised  to  secure  a  bottcr  total 
measuro  of  tho  skills  involved  in  the  maneuver. 

After  tliis  form  of  tho  measure  had  been  tried  out  on  several  students 
it  was  found  that  two  kinds  of  errors  were  mado  which  would  lower  tho 
subjective  evaluation  of  tho  steep  turn  but  which  were  not  being 
measured  objectively.  One  was  tho  tendency  of  tho  student  to  keep 
his  head  in  tho  cockpit  staring  at  tho  altimeter  with  only  occasional 
glances  outside  tho  piano  to  sco  where  bo  was  going  and  to  look  out 
for  other  planes.  This  was  considered  a  serious  error  in  a  student 
beenuso  every  studont  was  told  by  his  instructors  to  “keep  his  head 
on  a  swivel"  and  maintain  a  sharp  look-out  for  other  planes.  Tho 
other  unmeasured  error  was  lack  of  coordination  in  tho  turn  causing 
tho  piano  to  slip  or  skid.  Sinco  most  of  tho  planes  did  not  have  ball* 
bank  indicators  in  them,  and  sinco  calibrated  marks  would  have  to  be 
mado  on  tho  ball-bank  indicator  in  order  to  measure  objectively  the 
entire  slip  and  skid  rango,  tho  possibility  of  obtaining  ball-bank 
indicators  for  special  installation  and  uso  was  investigated.  In  order 
to  measure  tho  degreo  to  which  tho  student  looked  around  in  the  turn 

an  item  was  added,  Looks  around  60%  of  the  time,  Yes - No - - 

This  was  not  an  objectivo  measure  but  seemed  to  bo  a  necessary  con¬ 
dition  of  measurement  of  tho  steep  turn. 

Ono  other  change  was  found  necessary.  Sinco  Time  to  complete  the 
turn  was  being  measured  and  might  turn  out  to  be  valid  and  useful. 
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either  alone  or  in  combination  with  altitudo,  it  was  necessary  to  con¬ 
trol  conditions  for  this  tuno  measurement.  It  was  found  that  somo 
students  followed  their  instructor’s  teaching  and  rolled  into  tho  stoop 
turn  at  a  slow,  steady  rate,  while  others  attempted  to  get  tho  best 
time  scoro  possiblo  by  rolling  in  much  moro  rapidly,  sometimes 
gaining  an  ndvantngo.  .Furthermore,  it  was  not  considered  des»rablo 
to  cncourago  students  to  force  tho  piano  into  a  steep  bank  too  abruptly. 
Therefore,  to  avoid  teaching  tho  students  this  bad  tcchniquo  and  also 
to  keep  irrelevant  variability  at  a  minimum,  all  students  wero  given 
ample  timo  to  roll  into  tho  turn  and  to  roll  out.  Instead  of  being 
given  a  3G0°  turn  the  students  wero  given  a  turn  and  a  half,  or  540°. 
They  wero  allowed  90°  to  roll  into  tho  turn  and  90°  to  roll  out  of  it, 
with  only  tho  center  3GC°  measured.  This  is  shown  in  tho  next  form. 
This  form  was  administered  twico  (for  tost-rctcst  reliabilities)  to  91 
students  at  a  Primary  school  using  tho  PT-19  (Fairchild)  training 
piano. 

Form  3 

540®  Level  Tuhn  (Center  3C0®  measured) 

At  Cruising  R.  P.  M.  (Left): 

Time . see.  Looks  around  50%. 

Starting  Altitude _ _  ft. 

Lowest  Altitude  .......  ft. 

Highest  Altitude . ft. 

At  Cruising  R.  P.  M.  (Right): 

Time . see.  Looks  around  50%. 

Starting  Altitudo . ft. 

Lowest  Altitude  .......  ft. 

Highest  Altitudo . ft. 

At  Full  Throttle  (Left): 

Time . see.  Looks  around  50%. 

Starting  Altitude . ft. 

Lowest  Altitudo _ ft. 

Highest  Altitude . ft. 

At  Full  Throttle  (Right): 

Time . see.  Looks  around  50%. 

Starting  Altitude . ft. 

Lowest  Altitude _ ...ft. 

Highest  Altitude  _ _ ...  ft. 

Comments.. . . . . . 


Yes...  No... 


Yes  ...  No  ... 


Yes ...  No  ... 


Yes...  No... 


Following  this  study  the  Training  Command  decided  to  shift  from 
tho  Fairchild  Primary  training  piano  (PT-19)  to  tho  Stearman  (PT-13 
and  PT-17).  Tho  Stearman  is  a  biplano  with  a  third  moro  power  than 
tho  Fairchild  and  somowhat  dilTcrcut  flying  characteristics  in  stalls  and 
spins.  Wliilo  tho  measures  on  tho  steep  turn  had  worked  out  fairly 
well  on  tho  Fairchild  Primary  trainer,  it  was  not  known  whothcr  theso 
samo  measures  would  also  bo  cfTcctivo  on  tho  Stearman.  Accordingly, 
when  now  measures  wero  ready  for  trial  on  tho  Stearman,  soverol  of 
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tlio  ones  tried  out  on  the  Fairchild  wero  included  to  giro  an  indication 
of  tho  relationship  between  tho  two  planes. 

Since  Primary  students  are  taught  to  fly  “by  tho  scat  of  their 
pants"  as  well  as  by  rcfcrcnco  to  instruments,  a  comparison  was  made 
at  tho  Stcarman  Primary  school  between  performance  on  certain 
maneuvers  with  the  instruments  visible  and  performance  on  the  some 
maneuvers  with  all  tho  instruments  (air-speed  indicator,  altimeter, 
and  tachometer)  in  tho  student's  cockpit  covered.  Thus,  tho  only 
difference  in  the  next  form  of  tho  mcasuro  was  that  instruments  wore 
covered  during  one  of  tho  administrations.  Sinco  tho  tachometer  was 
covered,  it  was  necessary  for  tho  test  administrator,  who  had  tho  use 
of  the  instruments  in  his  cockpit,  to  set  tho  thrcttlo  for  cruising  and 
full-throltio  conditions  before  tho  student  perfonned  the  maneuver. 
In  all  other  respects  form  4  was  exactly  tho  same  as  form  3  and  is  not 
shown  hero. 

By  the  time  the  next  group  of  new  measures  was  ready  for  adminis¬ 
tration,  it  had  been  determined  that  tho  full-throttlo  maneuver  pro¬ 
vided  better  measures  than  tho  cruising-throttlc  maneuver  and  the 
cruising-throttle  had  been  dropped.  Ball-bank  indicators  had  been 
obtained  and  marked  off  in  zones  so  that  tho  degreo  of  slip  or  skid 
in  tho  turn  could  be  measured  objectively  by  tho  check-pilot.  This 
form  is  shown  below. 

Form  6 

540°  Level  Ton*  (Center  360*  measured) 

At  Full  Throttle  (Left); 

Time . see.  Looks  around  50%.  Ye*....  No... 


Starling  Altitude . ft. 

Lowest  Altitude . . . ft. 

Highest  Altitudo . ft. 


Maximum  deviation  of  ball-bank 

Zone  1 _  Zone  2 _ _  Zone  3....  Zone  4.... 

At  Poll  Throttle  (Right): 

Tlino . *cc.  J-ooks  around  50%.  Yea....  No... 


Starting  Altitude . ft. 

I x) wist  Altitude . .  ft. 

Highest  Altitude . ft. 


Maximum  deviation  of  ball-bunk 

Zone! _  Zone  2 _  Zone  3....  Zone  4  .... 

Comments . . . . . .  .................. 

Tho  300°  steep  turn  was  revised  again  and  used  in  tho  Primary  sec¬ 
tion  of  a  largc-scalo  study  of  tho  effects  of  additional  flying  training,  a 
description  of  which  appears  in  chaptor  10.  Beforo  this  study  the 
following  revisions  wero  mado. 

As  a  result  of  further  discussion  with  experts  it  was  decided  that 
altitudo  control  during  tho  roll-in  and  roll-out  was  ono  of  the  more 
important  factors  of  tho  turn.  Therefore,  in  eliminating  this  factor  in 


the  'A0°  turn  by  measuring  only  tho  center  360°,  an  important  aspect 
of  tho  maneuver  had  been  discarded.  In  tho  revision  this  aspect  was 
emphasized  by  requiring  tho  student  to  roil  directly  from  a  300°  steep 
right  turn  into  a  300°  steep  left  turn.  Since  experts  were  of  tho  opin¬ 
ion  that  the  poorer  students  might  loso  their  orientation  in  tho  two 
turns,  a  record  of  whether  or  not  the  student  came  out  within  45°  of 
tho  original  heading  was  included.  This  was  a  possiblo  measuro;  it 
also  helped  to  define  tho  conditions  more  exactly. 

After  preliminary  try-out,  it  was  found  possiblo  to  disperi30  with  tho 
time  measurement  and  to  substitute  a  report  of  whether  tho  student 
maintained  a  G0°  bank  in  both  of  tho  two  steep  turns,  ono  of  tho  stoop 
turns,  or  neither  of  them.  It  was  possiblo  to  do  this  with  tho  Stear- 
man  Primary  trainer  bccauso  when  tho  piano  is  in  a  60°  bank,  tho 
cabano  strut,  which  is  easily  visiblo  to  both  tho  student  and  tho 
instructor,  is  parallel  with  tho  horizon. 

Two  measures  wero  discarded.  Tho  item  on  Looking  around  60%  oj 
the  time  was  discarded  as  not  being  objcctivo  and  relatively  less 
important  as  a  conditioa  than  had  previously  been  thought.  Tho 
study  in  which  tho  students  wero  compared  under  conditions  of  instru¬ 
ments  covered  and  visiblo  had  shown  that  watching  tho  altimeter  made 
only  a  10%  diffcrcnco  in  altitudo  control.  Tho  ball-bank  doviation 
measuro  on  this  maneuver  turned  out  to  bo  not  discriminative  enough 
to  bo  used  as  a  measuro  and  probably  not  important  enough  to  bo  used 
as  a  limiting  condition. 

Tlio  altitudo  measure  remained  as  tho  most  important  ono  and  for 
tho  final  form  was  described  in  terms  of  deviation  from  a  starting 
altitudo  as  shown  in  Form  6.  Ono  of  tho  purposes  of  tho  preceding 
exploratory  studies  was  to  secure  distributions  of  altitudo  variations 
which  could  bo  used  to  set  definite  scoring  limits.  After  theso  dis¬ 
tributions  had  been  secured,  it  was  possiblo  to  establish  definite  limits 
and  allow  tho  student  to  know  exactly  how  ho  would  bo  scored. 

t 

Form  6.  The  Final  Form 
Two  300*  8teef  Tukns 
(Roll  Directly  From  Left  Turn  into  Right  Turn.) 

A.  Deviation  Fnoa  Startino  Altitude: 

Check  Highest  and  Low  Ear.1 

Loso  feet  •  Oaln  feet 

*-120  100  80  60  40  20  0  20  40  00  80  100  120-» 

Fl  I  I  I  I  I  I  T~  I  I  I  I.  J 

0  123450  7  8  0  10  11  13 

*  Scoring:  Highest  score  b  9  points  (or  range  In  sero  Interval;  I  point  subtracted  for  Meb  90  feet  Of  rang* 
so  that  check  mark  In  gain  30  and  Iom  (4  given  eevre  of  S.  No  score  below  sera. 

*  Marking:  0-+I0  to  —10;  20-11  to  30;  40-3!  to  16,  eta. 
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■L 


D.  Conditions  To  Be  Fulfilled:  Failure  in  Either  or  These  Mean*  Zero 
Score  on  Whole  Maneuver. 

1.  Reached  a  CO*  Bank  in  Each  Tuan  (Cadane  Strut  Parallel.  With 
Horizon) 

Yes  No 


1  0 

2.  Final  Roll-Out  Within ±45*  or  Startino  Hradino 

Ye*  No 


t  0 

No  other  changes  in  this  maneuver  seemed  indicated  and  it  was  not 
further  tried  out  in  two  later  administrations  of  experimental  check- 
rides  at  Primary  schools.  Tho  mcasuro  has  gone  through  a  number 
of  developmental  changes,  particularly  in  tho  Conditions,  which  have 
been  revised  and  developed  to  provido  a  suitablo  background  for  the 
critical  niensuro  of  altitudo  control.  It  will  bo  noted  that  tho  throttlo 
setting  is  no  longer  specified  and  that  maintaining  a  steep  bank  and 
completing  tho  turns  wero  found  to  be  tho  most  important  conditions 
to  bo  fulfilled. 

Other  measures  followed  a  similar  evolution. — This  succession  of  de¬ 
velopmental  changes  was  typical  of  the  measures  thnt  showed  promise 
and  wero  retained  for  further  work.  Many  measures  were  discarded 
when  administrative  or  statistical  inadequacies  wero  revealed,  but 
tho  better  ones  went  through  an  ovolution  analogous  to  that  of  altitude 
control  in  tho  steep  turn. 

Inventory  of  Measures  Devised  for  the  Primary  Level 

An  inventory  of  tho  measures  devised  is  given  in  tho  table  below. 
For  the  purposo  of  this  inventory  n  separato  measure  is  defined  ns  any 
observation  which  was  recorded  and  statistically  analyzed  separately. 
Thus,  landings  might  include  point  oj  landing  and  attitude  on  landing. 
Readings  on  the  samo  instrument  oro  considered  to  he  different  when 
they  aro  taken  under  different  conditions  or  in  different  maneuvers. 
Thus  air  speed  range  in  climbing  turns  and  air  speed  range  in  gliding 
turns  aro  different  measures.  Similarly,  altitude  range  in  steep  turns 
and  altitude  rang  in  tho  traffic  pattern  aro  two  different  measures. 
Minor  variations  such  ns  airspeed  range  in  climbing  turns  to  tho  right 
and  to  tho  left,  howover,  aro  not  considered  to  be  different  measures. 

Table  C.2. — Number  oj  measures  devised  and  developed  at  Primary  level  of  training 


Total  number  of  measures  devised . . . . . .  255 

Measures  discarded  after  preliminary  try-out  in  the  air . . . .  60 

Mcn.surc.i  discarded  becauso  of  tho  need  for  special  equipment,  or  not 

object  ifiablo  at  tho  Primary  level . . .  75 

Measures  retained  for  try-out  on  statistically  significant  number*  of 
student*.... . . . . . .  131 
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FIVE  ITEM -ANALYSIS  STUDIES:  PURPOSE  AND  PROCEDURE 
Purpose 

Five  studies  on  objective  measures  at  tho  Primary  level  of  training 
were  performed  by  the  Pilot  Project  in  order  to  obtain  a  first  coarso 
screening  of  items  on  the  basis  of  tho  reliability  and  validity  of  each 
individual  measure  and  tho  experience  gained  during  their  administra¬ 
tion.  This  section  describes  the  procedure  used  in  these  fivo  screening 
studies.  The  following  two  sections  summarize  tho  general  results  of 
these  screening  studies  and  present  a  description  and  evaluation  of 
specific  measures. 

It  was  planned  that  selected  measures  from  tho  fivo  screening 
studies  would  be  mado  into  an  organized  check  rido  and  put  to  a  inoro 
severo  test  in  a  further  study  on  ft  larger  number  of  coses.  This 
further  study  was  to  verify  tho  reliabilities  and  prcdictivo  powers  of 
theso  selected  measures  and  also  to  determine  their  intcrcorrolations. 
It  was  also  planned  to  obtain  a  total  scoro  so  that  tho  validity  and 
test-rctcst  reliability  of  tho  total  objective  check  rido  could  bo  ob¬ 
tained.  Tho  end  of  tho  war  and  tho  consequent  progressive  dis¬ 
ruption  of  tho  training  program  made  tho  last  planned  study  im¬ 
possible,  although  all  tho  arrangements  had  been  mado  for  it,  including 
tho  preparation  of  tho  check  rido  scoro  card  in  final  form. 

In  addition  to  tho  fivo  screening  studies,  identified  as  studies  I,  II, 
III,  IV,  and  V,  two  other  studies,  VI  and  VII,  were  performed  for 
other  purposes  and  will  bo  reported  in  later  sections  of  this  chapter. 

Procedure 

Methods  oj  measuring  rcliabill  •/  and  ralidity. — In  all  of  tho  fivo 
screening  studies  reliability  was  measured  by  tho  test-rctcst  method 
with  tho  interval  between  test  and  retest  constant  for  any  given 
experimental  group  at  one  day,  two  days,  or  threo  days.  In  oil 
cases  the  test  and  retest  wero  flown  in  different  planes  and,  oxccpt  in 
Study  I,  tho  test  and  retest  were  administered  by  different  check 
riders. 

Validity  was  measured  in  each  study  in  ono  or  moro  of  threo  ways: 

(1)  tho  nbility  of  tho  item  to  discriminate  between  two  groups  of 
students  differing  in  number  of  hours  of  training; 

(2)  the  prediction  of  graduation  or  elimination,  nnd 

(3)  the  nbility  of  tho  measure  to  discriminate  between  two  groups 
chosen  to  be  different  in  proficiency  ns  judged  by  their  instructors. 
These  different  methods  of  measuring  validity  Imvo  been  discussed  in 
chapter  4. 

In  all  of  tho  fivo  screening  studies  except  study  II,  validity  was 
measured  by  tho  nbility  of  the  measures  to  predict  graduation  and 
elimination  in  Primary  school.  In  study  II  tho  number  of  eliininces 
was  too  small.  In  studies  I,  II,  nnd  III  validity  was  further  measured 
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by  finding  tho  ability  of  each  mcasuro  to  discriminate  botween  two 
groups  of  students,  ono  with  a  greater  number  of  hours  of  training  and 
the  other  with  a  smaller  number  of  hours  of  training.  In  studies  IV 
and  V  a  second  measure  of  validity  was  tho  ability  of  tho  mcasuro  to 
discriminate  between  students  judged  by  their  instructors  to  be  in 
upper  or  lower  groups  with  respect  to  flying  proficiency. 

Summary  oj conditions. — Table  C.3  shows  for  each  of  tho  five  screen* 
ing  studies  a  brief  description  of  tho  groups  tested.  Column  1  shows 
the  number  of  the  study,  J»c  location  of  tho  Primary  school  where  the 
study  was  performed,  and  tho  typo  of  Primary  training  piano  used. 
Column  2  indicates  the  size  and  nature  of  the  groups  used  in  obtaining 
graduation-elimination  biscrial  correlations.  Columns  3  and  *  show 
for  studies  I,  II,  and  III  the  nature  of  the  groups  used  to  find  tho  re¬ 
lationship  between  number  of  hours  of  flying  training  and  score  on  tho 
objectivo  measures.  For  studies  IV  and  V,  columns  3  and  4  describe 
the  groups  used  in  calculating  validity  coefficients  based  on  instructors’ 
ratings  or  rankings.  Column  5  shows  the  naturo  of  tho  groups  used 
in  obtaining  tho  test-rctcst  reliability  measures. 

Sources  of  Variability 

Constant  errors  in  air  speed  indicators. — After  tho  first  few  check 
rides  in  study  I,  it  was  found  that  tho  air  speed  indicators  in  tho  dif¬ 
ferent  planes  had  various  constant  errors.  Following  this  discovery, 
each  check  rider  was  asked  to  report  for  each  check  rido  tho  indicated 
air  speed  on  his  plane  whilo  tho  plane  was  in  level  flight  at  cruising 
r.  p.  m.  (2050  r.  p.  m.  nt  this  school).  This  yielded  a  fixed  figuro 
which  was  tho  best  available  approximation  for  uso  in  correcting 
nbsoluto  air  speed  measures  during  take-off  and  during  spin  rccovciy. 
It  was  found  that  tho  indicated  air  speed  at  cruising  r.  p.  m.  in  lovcl 
flight  varied  from  70  ra.  p.  h.  on  one  piano  to  100  m.  p.  h.  on  another 
piano  with  most  of  tho  values  clustering  about  85  and  90  m.  p.  h.,  the 
correct  vulucs.  Sinco  Primary  schools  do  not  havo  instrument- 
calibrating  shops,  no  other  method  of  correction  was  possible.  Sinco 
calibration  measures  on  the  air  speed  indicators  wero  not  available,  it 
was  necessary  to  assumo  that  tho  error  in  tho  airspeed  indicators  was 
a  constant  ono  and  that  probably  tho  rango  measurements  wero  littlo 
affected,  i.  o.,  that  05  m.  p.  h.  minus  75  m.  p.  h.  wus  equal  to  115 
m.  p.  h.  minus  95  m.  p.  h. 

Change  to  Stcarman  plane. — Following  study  I,  which  was  dono  with 
tho  Fairchild  Primary  Trainer  (PT-19),  it  was  learned  that  tho  Train¬ 
ing  Command  planned  to  uso  only  tho  Stearman  Primaiy  Trainer 
(PT-13  or  1*T-17)  in  Primary  schools.  The  Fairchild  training  piano 
was  a  175-horsepower  low-wing  monoplane,  whilo  the  Stearman  was  a 
biplano  with  225  horsepower  and  had  possibly  different  flying  charac¬ 
teristics.  After  experience  had  been  gained  in  tho  Stcarman,  now 
measures  on  new  maneuvers  together  with  revisions  of  tho  maneuvers 
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nnd  measures  used  in  the  first  study  wero  devised  in  collaboration 
with  tho  Primary  Training  Advisory  Board.  Since  nono  of  the 
Primary  schools  in  the  Control  Flying  Training  Command  wero  using 
the  Stenrmnn  Primary  Trainer,  it  was  necessary  to  go  to  tho  Western 
Flying  Training  Command  to  obtain  students  trained  on  the  Stcar- 
man. 


Taiii.k  G.l. — Percents  of  validity  and  reliability  coefficients  at  each  level  of  significance 

Chances  in  100  of  obtaining  positive  coefficients  &s  largo  as  these,  if  thcro  wero  no 

rc’ationship  between  tho  variables. 


0.5  percent 

2.8  percent 

10  percent 

More  than 

10  percent 

Total 
number 
coe  in¬ 
dents 

fik.  m4<ellra  • . . 

10% 
'(0.  CO -0.21) 
/  11% 
\(a«H).37) 
22% 
(0. 02-0. 2s) 
11% 
(0.43-0. 28) 
2J% 
(a  71-0. 28) 

6% 

(0. 40-0.31) 
26% 
(0.38-0.31) 
10% 
(0. 27-0. 20) 
11% 
(0  27-0. 3>) 
11% 

23% 
(0.33-0.18) 
30% 
(0.30-4.  h) 

l«r» 

(0.10-0  14) 
147. 
(aio-o.it) 
13% 
(a  io-o.  i4) 

62% 
(a  17  or  leu) 
33% 
(20  or  less) 
50% 

(0. 13  or  less) 
04% 
(a  13  or  less) 
51% 

04 

r»n»\  rankings » . 

27 

rau.  flnt  dav  • . 

13S 

r.ku.  second  day  • . 

138 

r„,  tcat-rttcil  . . . 

1C2 

(a  27-0. 20) 

(a  13  or  less) 

Tefal  mcffldentfl . . . . 

550 

•  The  figures  In  parentheses  show  the  limit*  of  the  mngc  of  coefTlclent  J  obtained  at  each  significance  level. 

•  The  l>ts  rt.il  correlations  fur  the  ram  of  scores  on  two  dally  administrations  of  an  Item  versus  graduation 
or  Ovine  dcflrlrncy  elimination  In  ITlmarr  school. 

•  The  Mseriul  or  |viinl-lil««rlal  correlations  lor  sum  of  scores  on  two  dally  od  ministrations  of  an  Item  versus 
upper  and  low  i-r  prufleiency  croups  as  rnted  hy  the  sludenls'  Instructors. 

•  The  point -hiM-rial  correlations  for  each  Item  scorn  on  tho  first  day  versus  an  upper  group  with  mort 
hours  of  llylng  training  and  n  lower  group  with  fewer  hours  of  Hying  training. 

•  The  piliit-liPerial  correlations  for  each  Item-score  on  the  second  day  versus  an  upper  group  with  mort 
hours  of  living  training  and  n  lower  group  with  fewer  hours  of  flying  training. 

•  The  product-moment  rellahlllt  y  correlations  (or  Item -score  on  the  first  dey  of  testing  versus  Item-ecore  on 
the  second  day  of  testing  done  oue  to  throe  days  later. 

Propeller  pilch  variations  from  plane  to  plane. — Botween  studios  II 
and  III  tho  PT-13  replaced  tho  PT-17  planes  in  uso  at  Tularo  where 
tho  experimental  work  was  being  dono.  Theso  two  models  of  tho 
Stenrmnn  had  tho  sumo  flying  characteristics,  but  on  tho  PT-13  two 
types  of  propellers  wero  in  uso  and  theso  two  types  of  propellers  had 
different  pitches.  This  meant  that,  at  tho  sanio  rpm,  planes  with 
different  propellers  had  different  actual  air  speeds.  In  study  III  it 
was  necessary  to  uso  PT-13  planes  with  only  ono  typo  of  propeller — 
tho  MiicCnuley  propeller.  In  spito  of  this  control,  tho  pitch  of  tho 
propellers  was  found  to  vary  somcwhnt  when  measured  with  a  univer¬ 
sal  protractor.  It  is  believed  that  this  variation  in  pitch  was  not 
enough  to  affect  materially  tho  results  of  tho  experiment. 

Necessity  to  shift  work  from  a  population  of  cadets  to  one  of  returnees. — 
After  studies  I,  II,  and  III  had  been  completed,  it  was  announced 
that  until  further  notico  no  aviation  cadets  w’ould  rcccivo  flying  train¬ 
ing.  The  only  men  then  trained  in  Primary  schools  wero  bombardier 
nnd  navigator  officers  returned  from  combat  and  former  flying  in¬ 
structors  from  Primary  schools.  Most  of  tho  returnees  had  received 
various  amounts  of  unofficial  pilot  cxpcricnco  in  a  variety  of  tactical 
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equipment.  It  was  difficult  to  evaluate  tho  possible  influence  of  this 
experience  on  Primary  flyin"  proficiency.  With  this  kind  of  popula¬ 
tion,  both  the  criterion  of  number  of  hours  of  training  and  tho  criterion 
of  predicting  graduation-elimination  seemed  less  likely  to  provide  use¬ 
ful  results.  Accordingly,  it  was  planned  to  validato  new  objective 
measures  against  upper  and  lower  proficiency  groups  of  students  at 
approximately  tho  tenth  hour  of  training  with  the  proficiency  deter¬ 
mined  by  instructors’  ratings.  The  procedure  was  followed  in  studies 
IV  and  V. 

FIVE  ITEM -ANALYSIS  STUDIES:  GENERAL  RESULTS 

In  this  section  tho  results  on  measures  tried  out  during  tho  fivo 
screening  studies  at  Primary  schools  arc  summarized  in  terms  of  tho 
numbers  of  reliable  and  valid  measures.  In  the  next  section  tho  best 
individual  measures  on  specific  maneuvers  arc  described  and  evaluated. 
Tho  reliability  and  validity  of  each  of  the  measures  tested  is  presented 
in  the  appendix  to  this  chapter. 

Percents  of  Validity  and  Reliability  Coefficients  at  Each  Level  of 
Significance 

The  results  of  tho  five  screening  studies  nro  summarized  in  table 
6.4,  which  shows  tho  total  number  of  each  kind  of  validity  and  re¬ 
liability  coefficients  calculated  and  tho  percents  of  these  at  each  lovcl 
of  significance.  As  described  in  the  earlier  paragraphs  on  Procedure, 
fivo  different  groups  of  coefficients  wero  calculated: 

(1)  The  biscrial  correlations  for  tho  sum  of  scores  on  two  doily 
administrations  of  an  item  versus  graduation  or  flying  deficiency 
elimination  in  Primary  school; 

(2)  The  biscrial  correlations  or  point-biserial  correlations  for  tho 
sum  of  scores  on  two  daily  administrations  of  an  item  versus  upper 
and  lower  proficiency  groups  as  rated  by  tho  students’  instructors; 
biscrial  correlations  wero  used  when  the  proficiency  categories  wero 
continuous,  as  in  the  instructors’  rating  of  students  in  tho  upper  half 
or  lower  half  of  all  tho  students  in  tho  instructors’  exporienco;  point- 
biserial  correlations  wero  used  when  tho  proficiency  categories  wero 
not  continuous,  i  o.,  when  each  instructor  ranked  his  four  students 
and  tho  upper  proficiency  group  was  made  up  of  students  ranked  first 
and  tho  lower  proficiency  group  was  mado  up  of  students  ranked 
fourth; 

(3)  The  point-biserial  correlation  for  each  item-seoro  on  tho  first 
day’s  testing  versus  an  upper  group  with  moro  hours  of  flying  training 
and  a  lower  group  with  fewer  hours  of  flying  training;  these  groups 
wero  quite  different  in  number  of  hours  of  training,  o.  g.,  15  hours 
versus  55  hours,  and  10  versus  25  hours; 

(4)  Tho  point-biserial  correlation  for  each  item-score  on  tho  second 
day’s  testing  versus  an  tipper  group  with  more  hours  of  flying  training 
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and  a  lower  group  with  fewer  hours  of  flying  training,  as  described  in 
the  preceding  paragraph  (3); 

(5)  The  product-moment  test-rctcst  reliability  correlation  for  tho 
item-score  on  tho  first  day’s  testing  versus  tho  itcm-scoro  on  tho 
second  day’s  testing  done  1  to  3  days  later. 

Out  of  a  total  of  559  coefficients  summarized  in  tablo  6.4  one-half 
of  1  percent  would  be  expected  to  reach  tho  highest  level  of  significance 
by  chance.  In  these  studies  this  level  was  reached  by  10  percent  of 
tho  bisoriol  correlations  indicating  ability  to  predict  graduation- 
elimination  and  by  higher  percentages  up  to  25  percent  for  tho  other 
measures  of  validity  and  reliability.  While  these  figures  aro  not  largo, 
enough  of  them  arc  substantially  obovo  the  chance  level  to  indicate 
the  discovery  of  some  real  relationships  between  objective  measures 
and  flying  skill. 

It  will  be  noted  that  only  25  percent  of  tho  test-retest  reliabilities 
arc  at  the  highest  level  of  significance  (30  percent  at  the  top  two  levels). 
The  problems  of  obtaining  high  test-rctcst  reliabilities  in  tho  field  of 
objective  measures  of  flying  skill  will  bo  discussed  in  a  later  section  cf 
this  chapter. 

Bccauso  tho  conditions  in  tho  different  studies  mado  it  impossible 
to  sccuro  all  of  tho  types  of  coefficients  on  each  mcasuro,  it  is  not 
meaningful  in  this  tablo  to  comparo  tho  different  rows  reporting  tho 
different  types  of  correlations. 

Relationship  Ictwccn  tho  Different  Indices  of  the  Coodness  of  Each 
Measure 

It  will  bo  recalled  that  tho  measures  tried  out  in  studies  I  and  III 
were  evaluated  in  three  different  ways  by  determining:  (1)  Tho  ability 
of  tho  mcasuro  to  discriminate  between  students  with  different 
amounts  of  flying  training,  calculated  separately  for  each  of  tho  2 
days  of  testing  and  yielded  two  point-biscrial  coefficients;  (2)  tho 
ability  of  tho  sum  of  tho  two  administrations  of  tho  mcasuro  to  pre¬ 
dict  subsequent  graduation-elimination;  and  (3)  tho  test-rctcst  relia¬ 
bility  of  tho  measure.  In  order  to  determino  whether  tho  measures 
which  aro  best  according  to  ono  index  aro  also  best  according  to  anoth¬ 
er,  the  correlations  among  these  indices  wero  calculated.  This  was 
done  for  tho  63  measures  in  studies  I  and  III,  in  which  all  of  thoabovo- 
described  types  of  correlations  wero  availablo.  Tho  calculations  wero 
mndo  separately  for  studies  I  and  III  and  tho  results  combined  by 
Fisher’s  z-transfornmtion  technique.  In  order  to  correct  for  tho  fact 
that  correlation  coefficients  wero  not  distributed  normally,  tho  coeffi¬ 
cient  for  each  measure  wns  transformed  into  a  z-scoro  beforo  these 
correlations  wero  calculated. 

Similar  results  jor  same  measure  of  validity  on  different  days. — From 
tablo  6.5  it  can  l  j  seen  that  tho  correlation  between  tho  point  biserials 
on  tho  first  day  showing  relationship  between  item-scores  and  hours 
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ablk  G.5. — Intcrcorrclalion »  of  reliability  coefficients  and  the  ndidity  coefficients 
for  graduation-elimination  and  for  hours  of  training  (\fr=63)  1 


First  day 
r»ku 

Second  day 

r»fcii 

Omd«KUm 

rtta 

fll 

1  First  day,  rPku,  U.  versus  I.  . 

BO 

0.00 

-.07 

-a  24 
-  01 
-.09 

2.  Second  d.iy,  U.  versus  L . 

0.41 

.00 

-.24 

3.  Tbi*.  Rnvl-clim  ...  .....  . . . . . 

Hi 

4.  fn,  reliability . . . . 

-.CO 

i  Tin-  fljmres  shown  are  the  t-transformatlon  combination  of  separate  calculations  for  studies  I  and  III. 
Complete  data  are  found  In  t lie  appendix  (or  chapter  8. 

For  a  description  of  the  different  coefficients  see  table  6.4. 


of  training  and  tho  similar  point  biscrinls  on  tho  second  day  is  0.41. 
This  means  that  tho  measures  which  give  tho  best  discrimination  bo- 
tween  the  two  groups  with  different  amounts  of  training  on  tho  first 
day  also  tend  to  givo  tho  best  discrimination  on  the  second  day. 
Since  the  point  biserials  on  tho  first  day  aro  presumably  measuring  tho 
same  thing  as  the  point  biscrials  on  the  second  day,  this  correlation 
gives  an  indication  of  tho  reliability  with  which  differences  in  tho  dis¬ 
criminating  powers  of  tho  different  measures  havo  been  established. 
There  is  a  definite  relationship,  but  it  is  moderately  low,  probably 
because  the  point  biscrials  which  wero  correlated  wero  originally  com¬ 
puted  on  relatively  small  samples. 

Different  resvlts  jor  two  types  of  validity. — It  can  bo  seen  that  under 
exactly  tho  samo  conditions,  there  is  no  correlation  between  tho 
biscrials  indicating  tho  ability  of  tho  measures  to  predict  graduation- 
elimination  and  tho  point  biscrinls  indicating  their  ability  to  dis¬ 
criminate  between  students  differing  in  amounts  of  training.  This 
means  that  tho  measures  which  were  best  at  predicting  which  students 
would  pass  and  which  would  fail  wero  not  necessarily  best  at  dis¬ 
criminating  between  students  with  differing  amounts  of  training. 
Under  tho  conditions  of  theso  exploratory  studies,  tho  two  criteria 
represented  by  these  two  types  of  indices  seem  to  bo  independent  and 
to  test  for  different  types  of  relevance.  If  this  should  bo  a  general 
finding,  repeated  in  other  caiefully  controlled  and  moro  extensivo 
studies,  it  would  mean  that  the  errors  which  characterize  tho  student 
with  low  aptitude  aro  different  from  thoso  which  characterize  tho  in¬ 
experienced  one.  It  would  also  indicate  o  necessity  for  developing 
two  somewhat  different  batteries  of  measures:  one  to  measuro  tho 
results  of  training  experiments  and  another  to  select  students  for 
elimination  and  to  vaiidnto  classification  tests. 

Low  relationship  between  reliability  and  validity. — It  will  bo  seen  that 
the  correlations  of  the  reliability  coefficients  with  each  of  tho  other 
two  indices  is  low,  or  even  negative.  This  means  that  tho  measures 
which  wero  most  reliablo  wero  not  necessarily  tho  best  at  predicting 
graduation  elimination  or  discriminating  between  the  students  with 
different  amounts  of  training.  This  problem  of  the  icliability  of  ob¬ 
jective  measures  will  bo  taken  up  in  a  later  section  of  this  chapter 

127 


For  the  20  measures  tried  out  in  study  IV,  tho  rclirbility  coefficients 
correlate  practically  zero  with  tho  two  coefficients  of  validity,  viz,  tho 
hiserial  correlations  with  graduation  elimination  and  tho  point-biscrial 
correlations  with  the  instructors'  rating  of  students.  However,  tho 
correlation  between  tho  graduation-elimination  coefficients  and  tho 
ranking-criterion  coefficient  is  0.40,  which  reflects  tho  fact  that  tho 
rankings  and  tho  recommendations  for  elimination  wero  both  dono 
by  the  student’s  own  instructor.  Tho  detailed  data  aro  presented  in 
tho  appendix  to  this  chaptor. 

FIVE  ITEM- ANALYSIS  STUDIES:  DESCRIPTION  AND 
EVALUATION  OF  SPECIFIC  MEASURES 

In  devising  measures  of  a  particular  maneuver  the  attompt  was 
mndo  to  cover  all  of  tho  relevant  skills  it  was  possiblo  to  measure 
objectively,  particularly  tho  ones  most  characteristic  of  tho  maneuver, 
and  to  choose  items  which  measured  tho  efficiency  and  safety  of  tho 
student’s  performance.  For  many  important  aspects  of  tho  student’s 
flying  skill,  it  was  not  possible  to  deviso  objcctivo  measures.  For 
instance,  it  is  important  for  the  student  to  look  around  constantly  to 
bo  sure  that  no  other  piano  is  coming  so  close  to  him  that  thcro  is 
danger  of  a  collision.  Instructors  constantly  warn  students  about 
this  and  tho  successful  pilot  keeps  a  constant  lookout.  As  described 
in  the  section  on  tho  development  of  a  samplo  moasuro,  an  attempt 
was  made  to  get  instructor’s  judgments  of  whether  students  looked 
around  50  percent  of  tho  time.  This  moasuro  was  discarded  as  too 
variable  and  not  objcctivo.  Other  possiblo  measures  wero  not  tried 
out  when  it  wns  discovered  that  they  required  tho  development  of 
new  measuring  and  recording  instruments.  A  few  such  devices  were 
made;  for  instance,  a  slip-skid  recorder  which  was  developed  in  col¬ 
laboration  with  tho  Department  of  Psychology  of  tho  School  of  Avia¬ 
tion  Medicine.  It  wns  decided,  however,  that  tho  availablo  research 
time  could  bo  spent  most  efficiently  at  first  in  exploring  tho  objcctivo 
measures  that  wero  possiblo  using  tho  flight  and  engino  instruments 
availablo  on  tho  Primary  trainer.  Of  tho  engino  instruments,  only 
tho  tachometer  wns  useful  sinco  it  was  necessary  in  setting  a  certain 
specified  r.  p.  m.  ns  a  constant  condition  for  certain  maneuvers.  The 
only  flight  instruments  availablo  wero  tho  altimeter  and  tho  air  speed 
indicator  although  in  certain  experiments  ball-bank  indicators  were 
installed  for  tho  uso  of  tho  check  pilot. 

In  tho  following  paragraphs  tho  specific  maneuvers  and  their  meas¬ 
ures  and  tho  experimental  findings  on  them  aro  briefly  described. 
These  measures  arc  indicated  which  appeared  worthy  of  further  study 
and  development  and  which  would  be  desirablo  in  n  check  rido  de¬ 
signed  to  chooso  students  with  tho  greatest  present  and  potential 
proficiency.  A  number  of  factors  wero  taken  into  consideration  in 
the  selection  of  these  best  measures.  Tho  various  estimates  of  validity 


and  reliability  were  given  first  consideration.  It  was  also  necessary, 
however,  to  take  into  account  the  relevance  of  the  measuro  to  tho 
general  problems  of  flying  skill  nnd  the  importance  of  tho  measuro 
in  determining  the  pilot's  safety  nnd  efficiency  in  performing  tho  ma¬ 
neuver.  Finally,  when  two  items  seemed  to  be  measuring  the  same 
aspect  of  Hying,  only  one  was  chosen  for  further  trial.  It  was  neces¬ 
sary  to  achieve  a  balance  among  those  various  factors  in  choosing  tho 
most  likely  measures.  The  score  card  for  a  cheek  ride  mado  up  of 
these  selected  measures  is  presented  in  the  last  section  of  this  chapter. 

The  complete  data  for  the  validity  nnd  reliability  of  each  measuro, 
including  the  means,  standard  deviations,  nnd  correlation  coefficients 
are  shown  in  the  appendix  for  this  chapter. 

S*Tums 

In  tho  S-turns,  the  student’s  task  was  to  mako  a  ground  track  which 
formed  equal  semicircles  on  each  side  of  a  road  that  ran  cross-wind. 
Approaching  downwind  the  student  crossed  tho  road  at  right  angles 
to  it.  After  crossing  the  rond  the  student  made  a  semicircle,  returning 
to  the  rond  at  the  end  of  this  first  loop,  again  at  n  right  nnglo  to  tho 
rond.  In  the  second  loop,  the  student  was  on  tho  upwind  sido  of  tho 
road  nnd  again  tried  to  make  the  ground  track  of  the  plane  a  semicirclo, 
returning  to  the  rond  at  an  nnglo  of  90°.  Loops  3  nnd  4  wero  exact 
repetitions  of  loops  1  and  2  so  that  at  tho  end  of  the  maneuver  tho 
student  had  made  two  complete  S’s.  Tho  test  was  difficult  bccauso 
in  order  to  make  a  ground  track  of  good  semicircles,  the  student  had  to 
make  proper  drift  correction  by  varying  the  nnglo  of  bank  in  relation 
to  the  wind.  If  the  student  made  the  most  common  error,  ho  would 
undcrcorrect  for  drift  nnd  spend  a  long  time  on  the  loops  on  tho  down¬ 
wind  side  of  the  road  nnd  a  shorter  time  on  the  loops  on  tho  upwind 
side  of  the  road,  although  with  proper  corrections,  tho  downwind  and 
upwind  loops  would  take  the  same  amount  of  time.  Therefore,  a  good 
measure  of  drift  correction  was  the  sum  of  time  on  tho  downwind  loops, 
1  and  3,  minus  the  sum  of  time  on  the  upwind  loops,  2  and  4.  During 
all  the  loops,  the  student  had  to  be  careful  to  maintain  a  500-foot 
altitude,  nnd  also  to  have  the  plane  at  90°  to  the  road  and  tho  wings 
level  ns  he  crossed  tho  road. 

In  this  maneuver  tho  best  measure  was  tho  ono  on  Drijt  correction, 
tho  sum  of  tiino  for  tho  two  downwind  loops  (1  plus  3)  minus  tho  sum 
of  time  for  tho  two  upwind  (2  plus  4),  as  described  in  tho  preceding 
paragraph.  Tho  ability  to  make  drift  corrections  in  Hying  was  funda¬ 
mental  to  a  number  of  maneuvers.  This  nicasuro  had  a  biscrinl  cor¬ 
relation  of  0.41  with  subsequent  graduation  elimination  (NT=42).  Tho 
maneuver  was  a  diHicult  ono  and  was  regarded  by  pilot  instructors  ns 
indicative  of  understanding  of  tho  principles  of  drift  correction  nnd 
requiring  the  ability  to  fly  tho  piano  automatically  while  paying 
attention  to  its  courso  relative  to  tho  ground. 
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Altitude,  range  during  all  four  loops  was  olso  a  good  measure  sinco 
it  predicted  graduation-elimination  fairly  well  (rble=.34)  and  dis¬ 
criminated  fairly  well  between  students  with  10  hours  of  training  and 
those  with  25. 

The  check-pilot's  estimate  of  whether  the  Plane's  bank  changed 
through  level  over  the  road  at  the  end  of  each  loop  of  the  S-turn  w  as  not 
discriminative. 

Rectangular  Course 

In  the  rectangular  course,  the  student’s  task  was  to  keep  tho  piano 
at  a  constant  distance  from  tho  edge  of  a  rectangular  field,  regardless 
of  the  direction  of  the  wind.  In  going  around  tho  four  sides  of  this 
rectangular  field,  tho  student’s  most  difficult  task  was  at  tho  corners 
where  ho  made,  his  turns.  For  instance,  if  tho  student  was  going 
downwind  along  the  side  of  the  field  and  turned  to  go  crosswind  along 
the  side  of  tho  field,  he  had  to  make  the  turn  a  littlo  more  than  90° 
60  that  his  plane  would  be  -pointed  slightly  into  the  wind  and  would 
not  drift  away  from  tho  field.  This  crabbing  into  the  wind  had  to  bo 
just  the  right  amount.  If  he  crabbed  too  much,  ho  would  gradually 
edge  toward  tho  field.  If  ho  did  not  crab  enough  or  did  not  crab  at 
nil,  tho  piano  would  drift  away  from  tho  field.  A  similar  problem 
existed  when  the  student  was  going  upwind  along  the  side  of  a  field 
and  had  to  turn  crosswind.  Ilis  turn  in  this  case  was  less  than  90° 
if  the  ground  track  of  the  piano  was  to  remain  parallel  with  tho  field. 
As  can  easily  be  seen,  the  task  becomes  still  more  complex  if  the  wind 
was  quartering  across  the  field  and  not  blowing  parallel  to  any  of  tho 
sides.  In  addition  to  this,  the  student  had  to  hold  Iris  altitudo  con¬ 
stant  at  500  feet  abovo  the  ground. 

The  altitude  range  on  four  legs  of  tho  rectangular  courso  proved  to 
bo  a  discriminating  measure.  Tho  drift-correction  in  tho  rectangular 
courso  was  not  a  discriminating  measure  and  apparently  did  not  iden¬ 
tify  the  good  or  poor  student  as  well  ns  tho  drift-correction  measure 
in  tho  S-tum. 

Take-Off,  Climb,  and  First  Turn 

The  student’s  task  in  this  maneuver  was  to  lino  tho  plane  up  with 
the  “T,”  open  tho  throttlo  smoothly  and  continuously  to  full,  mako 
a  straight  take-oil  run,  climb  at  a  constant  air  speed  of  70  in.  p.  h., 
level  oH  at  300  feet  abovo  tho  ground,  and  mako  a  coordinated,  lovcl 
00°  turn.  During  tho  takc-ofT  run  and  tho  climb,  tho  student  had  to 
remain  on  a  ground-track  parallel  with  tho  “T."  When  thcro  was  a 
slight  crosswind,  ho  had  to  counteract  it  by  holding  proper  rudder 
correction  on  tho  ground,  or  in  the  air  by  crabbing  **  slightly  into  the 
wind. 


*  When  the  pitot  It  fl>  In*  on  *  trotim)  track  that  I*  crovwlod  to  »njr  ostent.  tho  plane  drift*  #wi»y  from  tho 
ti»:k  udIcm  H  li  beaded  Into  tho  wind  enough  to  counkrruct  tho  drift.  This  correction  Is  called  "crib,” 
probably  Ik-tiium  tho  piano's  movement  In  relation  to  tbo  fround  has  ■  sideward  component 
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Of  tho  eight  measures  tried  out  on  this  important  maneuver,  tho 
following  four  were  judged  good  enough  to  warrant  further  develop¬ 
ment: 

Continuous  or  interrupted  application  of  throttle  during  take-off  was 
an  important  measure,  since  the  indecisive  student  advanced  tho 
throttlo  in  a  series  of  short  pushes,  which  lengthened  tho  take-off 
roll  and  also  made  torquo  correction  more  difficult.  Tho  better  stu¬ 
dent  advanced  the  throttle  slowly  but  continuously  and  without  inter¬ 
ruption,  which  shortened  the  take-off  roll  and  made  torquo  correction 
easier.*1 

The  continuous  or  interrupted  naturo  of  throttlo  application  was 
easy  for  the  check  rider  to  observo,  sinco  tho  throttlo  as  well  as  tho 
stick  and  rudder  in  tho  check-rider’s  cockpit  wero  rigidly  connected 
with  tho  corresponding  controls  in  tho  student’s  cockpit.  During 
tho  take-off  in  tho  Primary  trainer  tho  check-rider’s  left  hand  w as 
customarily  on  tho  throttlo  so  that  continuous  or  discontinuous 
application  was  easily  observable. 

Student  lets  pla.ie  fy  off ,  pulls  it  off,  or  holds  it  on  ground  was  found 
to  bo  useful  and  also  accurately  judged  by  tho  pilot  observer.  It 
was  first  attempted  to  mcasuro  this  part  of  tho  maneuver  by  having 
tho  check-pilot  record  tho  Indicated  air  speed  as  the  wheels  left  the 
ground.  This  was  neither  a  rcliablo  nor  valid  mensuro  oven  after  tho 
indicated  air  speed  was  corrected  for  variations  in  tho  air-speed  indi¬ 
cator.  This  mensuro  was  poor,  possibly  because  tho  correction  was 
inadequate,  but  moro  probably  because  tho  check-pilot  was  under¬ 
standably  unwilling  to  turn  his  attention  from  tho  outsido  situation  to 
the  instrument  panel  while  an  inexperienced  student  was  taking  off. 

Air  speed  range  from  20-feet  altitude  to  lecel-off  for  first  turn  was  a 
good  mensuro.  Tho  student  who  held  hiu  air  speed  fairly  constant, 
even  if  it  was  a  little  too  high  or  too  low,  was  better  than  ono  who 
fluctuated,  especially  in  a  maneuver  closo  to  tho  ground. 

Altitude  range  during  first  turn  showed  up  fairly  well  statistically 
and  was  important  bccauso  the  student  had  to  mnko  a  level  turn  whilo 
watching  out  for  other  planes  and  planning  his  exit  from  tho  traflio 
pattern. 

Tho  following  measures  did  not  show  enough  promiso  to  warrant 
further  development:  Ground  control  during  take-ojf,  Air  speed  reading 
as  plane  leases  ground,  Plane  drift  during  climb,  and  Slipping  or  skidding 
during  first  turn  as  shown  by  a  ball-bank  indicator. 

Accuracy  Landing:  Traffic  Pattern  and  Power-Off  Approach 

In  tho  usual  Primary  traffic  pattern  for  a  00*  power-off  approach 
(illustrated  in  figure  3.1  in  chapter  3),  tho  student  flow  at  an  altitude  _ 

M  In  the  Prlmery  TnUner  ■  number  of  feotorr,  eoUrctlrrly  l» hr  1*1  "torque,"  would,  If  uncontrolled,  nub# 
the  pltne  turn  dnmrorously  to  the  left.  Torque  correction  con  listed  of  toougb  pressure  on  the  rtabt  rudder 
to  bold  the  pUne  straight  during  the  Uke-ofI  roll. 
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of  500  feet  above  the  ground  and  bended  tho  plnnc  toward  tho  field 
in  such  a  wny  tlmt  with  a  turn  of  45°  ho  was  flying  downwind  outside 
the  edge  of  tho  field  (downwind  leg).  Flying  downwind,  when  ho 
rcnched  n  point  approximately  500  feet  beyond  tho  downwind  edge 
of  the  field  Jio  made  a  00°  turn  to  the  left  and  flew  crosswind  (base  leg) 
part  of  the  way  across  the  end  of  the  field.  Ho  then  closed  tho  tlirottle 
and  inndo  another  90°  left  turn  and  glided  directly  toward  tho  field 
(final  approach),  gliding  in  and  landing  upwind.  .... 

In  Primary  schools  the  direction  of  tho  final  approach  and  landing, 
and  therefore  of  the  other  parts  of  tho  traffic  pattern,  were  determined 
by  the  direction  of  tho  "T  "  The  “T”  was  a  ground  marker  set  by 
tho  control  tower  so  that  it  was  on  ono  of  tho  eight  points  of  tho  com¬ 
pass  and  pointed  as  nearly  upwind  as  possible.  Since  tho  “T”  nad 
only  eight  settings,  it  was  not  always  pointing  directly  upwind,  tho 
plnnc  might  have  a  tendency  to  drift  sidoways,  which  tho  student  had 
to  counteract  on  tho  downwind  leg  by  crabbing  and  on  tho  final  ap¬ 
proach  by  crabbing  or  slipping.  If  there  was  any  wind  at  all,  the 
student  had  to  crab  on  tho  bnso  leg  in  order  to  correct  for  drift  and 

maintain  tho  proper  rectangular  pattern. 

Tho  student's  task  in  this  maneuver  was  to  enter  tho  middlo  third 
of  tho  downwind  leg  of  tho  traffic  r«e»?nglo  at  a  45°  anglo;  maintain 
Uio  correct  500  feet  abovo  tho  ground  on  tho  dow’uwind  leg  and  on  tho 
baso  leg  until  tho  throttlo  was  cut;  cut  tho  throttle  at  tho  desired  point 
which  would  allow  landing  in  tho  correct  area;  glido  with  power  off 
at  the  correct  gliding  speed  and  attitudo;  mako  a  coordinated  gliding 
turn  onto  tho  approach  leg,  starting  tho  turn  onto  the  approach  leg 
at  least  300  feet  above  tho  ground;  mako  tho  final  approach  path 
parallel  with  tho  l4T"  and  exactly  lined  up  with  tho  desired  landing 
area,  correcting  for  any  drift  produced  by  crosswind;  and  finally  to 
break  tho  glido  and  land.  It  was  desirablo  to  plan  the  pattern  and 
point  of  closing  tho  throttlo  so  that  tho  piano  did  not  overshoot  the 
field  and  so  that  no  moro  throttlo  was  needed  to  got  into  tho  field 
safely.  If  tho  piano  was  going  to  undershoot,  however,  tho  studont 
had  to  sco  this  himself  and  add  power  beforo  it  was  necessary  for  the 
instructor  to  tell  him. 

Tho  best  measures  of  this  particular  maneuver  wero  (1)  Altitude 
range  in  the  traffic  pattern,  (2)  Air-speed  range  in  the  final  approach  glide, 
(3)  Whether  student  changed  final  approach  course  or  S’d  to  hit  the 
correct  landing  spot,  and  (4)  Whether  the  student  had  correctly  judged  hie 
total  approach  so  that  no  added  power  was  necessary  on  the  final  approach 
leg.  Altitudo  control  was  again  ono  of  tho  best  measures.  Air-spoed 
rango  in  tho  final  approach  glido  on  landing  was  ono  of  tho  most  im¬ 
portant  aspects  of  tho  landing.  Tho  studont  had  to  attend  to  a  largo 
number  of  duties  and  yet  also  had  to  keep  his  air  speed  high  enough 
so  that  ho  did  not  stall  and  fall  into  tho  ground,  and  also  had  to  keep 
his  air  speed  low  enough  so  that  ho  could  land  successfully  in  the 
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correct  area.  Students  whose  nir  speed  fluctuated  widely  wero  not 
safe  or  accurato  flyers. 

Less  valuablo  measures  wero  (1)  Whether  student  entered  the  down¬ 
wind  leg  in  the  middle  third,  (2)  Whether  the  turn  on  to  the  final  approach 
leg  was  started  between  800  and  500  jeet  above  the  ground,  and  (3) 
Whether  student  maintained  glide  track  parallel  with  “T"  on  final 
approach. 

Similar  measures  wero  tried  out  with  power-on  landings  and  with 
cross-wind  landings.  Tho  results  wero  tho  samo  ns  thoso  described 
abovo. 

Accuracy  Landing:  Place  and  Manner  of  Ground  Contact 

The  student’s  task  in  an  ordinary  power-off  landing  was  to  put  tho 
piano  down  in  tho  first  third  of  tho  field.  lie  had  to  cut  tho  throttle 
at  the  proper  point  on  tho  bnso  leg  so  that,  after  turning  and  gliding 
on  down  without  power,  lie  would  not  land  too  closo  to  tho  near  end 
of  tho  field  and  not  beyond  tho  middlo  of  tho  field.  If  thcro  was  a 
slight  crosswind  and  tho  student  had  to  crab  or  put  a  wing  down  into 
tho  wind  to  compensate  for  this  crosswind,  ho  had  to  tako  off  tho  crab 
just  beforo  tho  piano  touched  or  tho  landing  would  ho  sideways  to 
somo  extent.  If  the  piano  was  moving  sideways  bccauso  of  under- 
or  over-correction  for  drift  or  for  failuro  to  rcinovo  emb  at  tho  last 
moment,  tho  piano  would  liavo  a  strong  tendency  to  groundloop. 
Tho  student  also  tried  to  bring  tho  piano  down  closo  to  tho  ground  so 
that  when  it  is  in  a  tlirec-point,  or  stall,  position  it  was  no  moro  than 
3  feet  abovo  tho  ground.  If  tho  piano  touched  slightly  wheels  first, 
tho  anglo  of  attack  of  tho  wings  was  changed  and  tho  piano  appeared 
to  bounco  back  into  tho  air,  after  which  tho  student  had  to  mako  an¬ 
other  landing.  In  tho  accuracy  landing  tho  student  was  trying  to 
put  tho  piano  down  in  a  specific  area,  in  tho  enso  of  tlicso  tests  an 
area  200  feet  wide  and  GOO  feet  long. 

Tho  two  best  measures  of  this  maneuver  wero  (1)  Landing  attitude: 
whether  tho  student’s  landing  was  smooth  three-point,  toil  first, 
wheels  first,  or  three-point  lut  dropped  in  3  feet  or  moro;  and  (2) 
Whether  plane  bounced  more  or  less  than  3  Jeet  on  landing.  In  contrast 
with  these  aspects  of  the  landing,  it  was  surprising  to  find  that  place 
oj  landing  was  not  a  discriminative  mensuro,  although  tho  zono  in 
which  tho  plane  lands  wns  a  matter  of  considerable  interest  to  flying 
instructors  ami  he  object  of  considerable  practice  by  students.  How¬ 
ever,  it  seems  likely  that  tho  student’s  attempt  to  land  in  a  particular 
zono  was  an  important  part  of  tho  maneuver,  partly  ns  a  complicating 
condition  which  tho  student  tried  to  fulfill,  and  partly  bccauso  tho 
plnco  of  larding  wns  tho  principal  goal  of  tho  maneuver.  Thcro  was 
somo  cvidonco  suggesting  that  all  three  of  theso  measures  of  landing 
were  somewhat  moro  discriminating  when  tho  student's  task  was  to 
land  in  a  specified  small  area  200  feet  wido  and  GOO  feet  long. 
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Two  other  measures  were  tried  out  in  wliich  tho  instructor  judged 
whether  the  student  landed  in  a  crab  or  landed  drifting.  It  was  con¬ 
cluded  that  these  two  measures  were  too  difficult  to  objectify.  Tho 
reliability  of  these  landing  measures  was  particularly  low,  possibly 
because  of  the  presence  of  gusts  and  irregular  wind  velocities  near  tho 
ground.  The  reliabilities  of  landing  measures  aro  discussed  in  tho 
section  of  this  chapter  concerned  with  tho  general  reliability  of 
objective  measures. 

Recovery  Landing,  After  Bounce  or  Zoom 

In  these  maneuvers  lunding  attitudo  and  bounco  wero  measured 
when  the  student  landed  the  plane  after  the  instructor  had  cither 
bounced  the  plane  or  zoomed  the  plane  up  after  coming  close  to  tho 
ground.  The  student’s  task  in  each  caso  was  to  tako  over  tho  piano 
after  the  simulated  bad  landing  and  to  do  whatever  was  necessary 
to  bring  the  plane  down  smoothly  in  a  three-point  landing.  Tho 
validities  and  reliabilities  of  these  measures  indicate  that  they  were 
not  useful. 

Simulated  Forced  Landing 

In  this  maneuver  the  check  rider  closed  the  throttlo  when  tho  piano 
was  going  downwind,  1,200  feet  nbovo  tho  ground,  and  directly  over 
a  suitable  field  which  had  been  pointed  out  to  the  student  ns  tho  placo 
where  lie  should  simulate  a  forced  lauding.  Unliko  tho  usual  forced- 
landing  practice  situation,  the  student  was  completely  familiar  with 
where  he  was  expected  to  land  and  with  the  aspects  of  tho  maneuver 
on  which  he  was  to  be  graded.  The  student’s  task  was  to  glido  down 
at  the  70-m.  p.  h.  gliding  speed,  establish  a  bnsc  leg  on  tho  downwind 
sido  of  the  field  and  to  begin  n  final  approach  that  would  allow  him 
to  land,  power  off,  upwind,  in  tho  first  two-thirds  of  tho  field. 

While  the  reliabilities  of  theso  singlo  administrations  were  only 
occasionally  above  tho  chauco  level,  graduation-elimination  correla¬ 
tions  based  on  tho  nverngo  of  the  test  and  retest  scores,  wero  sig¬ 
nificantly  positive  for  air  speed  range  in  glide,  simulates  base  leg,  and 
comes  in  upwind ,  downwind,  crosswind.  The  value  of  theso  measures 
might  shrink  upon  trial  with  a  largo  enough  number  of  eases  to  be 
statistically  stable.  However,  tho  obtained  values  wero  significant 
enough  to  warrant  another  trial.  As  with  tho  other  landing  measures, 
place  of  landing,  which  was  an  item  of  obvious  practical  valuo  in  a 
forced  landing,  did  not  seem  to  havo  discriminative  power  as  a  measure 
of  proficiency. 

Four  180°  Climbing  Turns:  Left,  Bight,  Left,  Right 

In  this  maneuver  tho  student’s  task  was  to  climb  tho  airplano  at  the 
proper  air  speed  and  r.  p.  m.  and  to  correct  for  torquo  in  6uch  a  manner 
that  a  climbing  turn  to  tho  left  would  tako  tho  samo  amount  of  timo  as 
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a  climbing  turn  to  the  right.  This  was  a  real  problem  since  without 
torque  correction  the  airplane  would  make  a  climbing  turn  to  tho  left 
much  more  rapidly  than  to  tho  right. 

The  correction  for  torque  was  made  with  the  rudder,  in  tho  enso  of 
climbing  turns  with  right-rudder  pressure.  Whilo  holding  right- 
rudder  pressure  the  student  also  had  to  bo  careful  to  make  tho  turn  ft 
coordinated  one,  that  is,  not  to  put  on  so  much  rudder  that  ho  would 
slip  in  the  left  turn  or  skid  in  tho  right  turn. 

Of  tho  five  measures  tried  out  on  this  maneuver,  nono  showed  a 
useful  combination  of  characteristics.  Tho  mensuro  of  proper  torque 
correction,  i.  c.,  the  difference  in  time  for  climbing  turns  to  tho  right 
and  left,  showed  some  reliability  but  very  little  validity.  This  was 
characteristic  of  time  measures.  Students  were  apparently  consistent 
in  tho  amount  of  time  taken  to  do  particular  maneuvers,  but  timo  was 
not  relevant  to  their  proficiency  in  any  way.  Tho  air  speed  range  in 
tho  four  climbing  turns  gavo  variablo  results.  Another  mensuro,  tho 
student’s  tendency  to  slip  or  skid  ns  shown  by  tho  maximum  deflection 
of  tho  ball  in  the  ball-bank  instrument  was  not  discriminative. 

Four  180°  Gliding  Turns:  Left,  Right,  Left,  Right 

In  a  gliding  turn  tho  student’s  task  was  to  set  tho  piano  in  an  atti¬ 
tude  in  which  it  would  glido  at  tho  correct  air  speed  and  also  to  mako 
tho  turns  to  tho  left  and  right  holding  tho  correct  amount  of  left 
rudder 36  so  that  tho  rate  of  turn  would  bo  tho  snmo  in  both  directions. 
If  tho  student  coordinated  stick  and  nidder  properly,  tho  ball  in  the 
ball-bank  indicator  would  remain  centered  throughout  tho  turn.  Of 
tho  four  types  of  measures  tried  on  this  maneuver,  one  turned  out  well 
enough  to  warrant  further  investigation.  This  was  tho  air  speed  range 
during  tho  four  gliding  turns.  In  threo  successive  experiments  it 
showed  ability  to  differentiate  students  with  a  greater,  from  those 
with  a  smaller,  number  of  hours  of  training.  The  point-bisoriul  corre¬ 
lations  ranged  from  0.17  to  0.45. 

Tho  other  measures  were  not  promising.  The  timo  measure,  tho 
difference  in  duration  jor  turns  to  the  right  and  left,  again  showed  fair 
reliability  but  little  validity.  Coordination,  as  measured  by  Dejtee - 
tion  oj  the  ball  in  tho  bull-bank  indicator,  had  little  discriminating 
power. 

360°  Steep  Turns  at  Cruising  Throttle 

In  theso  steep  turns  at  cruising  throttlo  tho  student  was  allowed 
90°  to  roll  into  tho  bank  beforo  entering  tho  300°  turn  and  90'*  to  roll 
out  after  completing  the  300°  turn.  Thus  tho  student  actually  turned 
through  540°,  although  measurements  were  mado  on  only  tho  middlo 

m  The  left-rudder  pressure  was  necessary  In  tha  Primary  training  plan*  because  o I  built-in  cbareetoriftlca 
which  mad*  tornuo-conectloai  with  either  right  or  left  rudder  unnecessary  at  cruising  spee«U  but  mad* 
tome  left-rudder  pressure  necessary  for  correct  flight  at  tha  lower  air  speed  of  a  |Ude.  TbU  left -rudder  prw 
aura  la  eliding  turns  was  sometime*  known  ai  “rarerso-tortjua"  oorractloa. 
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300°.  The  student’s  task  was  to  perform  a  3G0°  turn  nt  cruising 
throttle  as  rapidly  ns  possible  and  without  changing  altitudo.  Tho 
student’s  task  was  complicated  by  tho  fact  that  if  he  banked  the  plane 
up  too  steeply  for  tho  power  setting,  he  was  likely  to  lose  altitude. 
On  the  other  hand  if  he  did  not  bank  the  piano  as  steeply  as  possible 
he  would  not  get  around  the  360c  as  quickly.  He  also  had  to  keep  a 
sharp  lookout  for  other  planes. 

The  time  measurements  on  this  maneuver  ( time  in  seconds  to  com¬ 
plete  the  SCO *  turns)  were  among  the  most  rcliablo  of  any  measures 
that  were  obtained,  ranging  up  to  0.71.  However,  tho  time  measures 
did  not  correlate  with  the  hours  criterion  or  with  graduation-elimina¬ 
tion.  look's  around  60  percent  oj  the  time  was  of  doubtful  objectivity 
and  was  put  in  at  the  insistence  of  flying  instructors,  as  described  in 
the  introductory  section  of  this  chapter. 

Tho  best  measure  on  this  maneuver  was  altitude  range  which  cor¬ 
related  vciy  well  with  number  of  hours  of  training,  although  the 
correlation  on  the  second  test  ride  was  not  ns  goed  as  on  the  first. 
This  maneuver  was  probably  not  as  good  for  testing  purposes  as 
tho  same  maneuver  nt  full  throttle  described  next. 

360°  Steep  Turns  at  Full  Throttle 

The  student’s  task  was  the  same  in  this  maneuver  as  it  was  in  tho 
previous  maneuver,  although  ho  had  tho  greater  amount  of  power 
allowed  by  full  throttle.  Again  the  time  measurements  had  tho  high¬ 
est  reliability  and  the  lowest  correlation  with  hours  and  with  gradua¬ 
tion-elimination.  Looks  around  60  percent  oj  the  time  was  again  of 
doubtful  objectivity,  had  some  reliability,  somo  correlation  with  hours, 
and  very  little  correlation  with  graduation-elimination. 

Altitude  range  was  again  the  measure  with  the  best  correlations  with 
tho  hours  criterion  and  somo  correlation  with  graduation-elimination. 
As  described  in  an  earlier  section  of  this  chapter,  further  administra¬ 
tion  of  this  maneuver  will  probably  uso  a  mcasuro  of  degreo  of  bank 
instead  of  requiring  tho  check  rider  to  mcasuro  the  timo  that  was 
taken  for  tho  3G0C  turn. 

The  measure  of  coordination  in  terms  of  deflection  of  tho  ball  in  the 
ball-bank  indicator  was  again  substantially  valueless, 

Tho  instrumcnts-covered  versus  instrumcnts-visiblo  measures  in 
study  II  show  comparable  results,  although  it  was  unfortunately  not 
possihlo  to  compare  them  on  correlations  with  graduation-elimina¬ 
tion.*1 

Maintaining  Altitude  While  Reducing  Air  Speed 

Tho  student’s  task  was  to  maintain  altitudo  whilo  reducing  air 
speed  from  00  m.  p.  h.  to  70  m.  p.  h.  and  to  hold  air  speed  at  70  m.  p.  h. 

it  It  «u  InbreMlng  to  note  that  the  student*  held  a  constant  altitude  almost  as  welt  with  Instruments 
covered  as  with  Instrument*  visible.  Apparently  flying  vu  don*  by  attention  to  tbo  attitude  ot  tbs 
plan*  aud  not  bjr  concentration  on  tbo  altimeter. 
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until  told  to  stop.  Observations  of  altitude  were  mndo  for  a  period 
of  1  minute  after  the  beginning  of  tho  maneuver  at  a  cruising  air 
speed  of  90  m.  p.  h.  Two  trials  were  given  each  day. 

The  altitude  measures  on  tlio  first  day’s  trials  correlated  0.34  with 
hours  of  training,  but  on  the  second  day’s  trials  the  correlation  dropped 
to  0.01.  This  maneuver  was  unfamiliar  to  the  primary  school  stu¬ 
dents,  at  least  at  the  15-hour  level,  the  level  of  the  lower  class.  Tho 
upper  class  was  evidently  ablo  to  do  it  fairly  well  tho  first  time,  since 
they  did  not  improve  from  the  first  trial  of  tho  first  day  through  tho 
second  trial  of  the  second  day.  The  lower  elass,  however,  improved 
steadily  from  the  first  trial  of  the  first  day  through  tho  second  trial 
of  the  second  day  and  on  the  last  trial  of  the  second  day  did  just  as 
well  ns  tho  upper  class.  Sinco  these  measures  wero  being  tried  out 
for  possible  later  continued  uso  with  classes  at  Primary  schools,  it  did 
not  seem  desirable  to  develop  this  measure  further.  If  ono  or  two  days 
of  practico  could  remove  tho  discriminating  power  of  tho  moasuro, 
then  continued  coaching  by  flying  instructors  would  probably  do  at 
least  ns  much. 

Forward  Slip 

In  the  forward  slip  the  instructor  closed  tho  throttle  and  established 
a  70-m.  p.  h.  glide  along  a  long  straight  road  or  section  lino  pnrnllcl  to 
tho  wind.  The  student’s  task  was  to  point  the  noso  of  tho  piano  a 
little  off  to  ono  side  of  the  road  and  lower  tho  opposite  wing  enough 
so  that  tho  piano  would  slip  and  remain  over  the  rond  during  a  descent 
of  500  feet.  lie  was  instructed  to  slip  enough  so  that  tho  ball  in  the 
ball-bank  indicator  was  deflected  at  least  one-half  ball-width  through¬ 
out  the  maneuver.  The  student  also  had  to  raiso  or  lower  tho  noso 
of  tho  piano  sufficiently  so  that  the  indicated  air  speed  would  remain 
between  G5  and  75  m.  p.  h. 

Of  the  four  measures  on  this  maneuver,  the  best  ono  was  highest 
air  speed  during  the  slip,  which  had  a  biserial  correlation  with  subse¬ 
quent  Primary  graduation-elimination  of  0.39,  based  on  57  studonts. 
Apparently  tho  most  important  error  mode  during  the  forward  slip 
was  to  allow  tho  air  speed  to  bccomo  too  high.  Slipped  at  least  one - 
half  ball-width  throughout  tho  maneuver  was  also  fairly  diagnostic. 
Other  measures  that  wero  less  useful  wero  air-speed  range  during  slip 
and  plane  over  road  throughout. 

Slipping  Turn  of  90® 

In  this  maneuver  tho  instructor  closed  tho  throttlo  and  established 
a  70-m.  p.  h.  glide.  Tho  student’s  task  was  to  put  tho  piano  into  a 
sljp  (as  described  under  forward  slip),  mako  o  turn  of  exactly  00°, 
maintain  a  G5-70  m.  p.  h.  indicated  air  speed,  and  keep  tho  piano  in  a 
slip  throughout  the  turn  without  stalling  it. 

Of  tho  five  measures  on  this  maneuver  tho  two  most  promising 
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were  remained  in  slip  throughout  the  turn  and  recovered  from  turn  at 
00° ±6°.  The  other,  poorer  measures,  were  air-speed  range,  highest 
air  speed  during  turn,  and  plane  stalled  or  not. 

Tho  measures  in  the  forward  slip  and  the  slipping  turn  oj  90°  did 
not  show  enough  promiso  to  warrant  tho  inclusion  of  cither  whole 
maneuver  in  tho  proposed  check  rido  presented  at  the  end  of  this 
chapter. 

Estimation  of  Altitude,  Air  Speed,  and  R.  P.  M.  with  Instruments  Covered 

In  many  primary  flying  situations  tho  most  diflicult  aspect  for  the 
student  was  tho  perception  of  minimal  cues  which  signaled  tho  neces¬ 
sity  for  iinmcdiato  adjustment  on  tho  controls.  For  instance,  when 
tho  plane  approached  a  stall  in  straight-and-lcvcl  flight,  a  simplo  for¬ 
ward  movement  of  tho  stick  would  climinato  this  danger  and  tho  stu¬ 
dent's  only  problem  was  to  recognize  tho  visual,  auditory,  and  tactual 
signs  of  tho  approaching  stall.  To  tho  inexperienced  student  this 
was  diflicult,  whilo  to  tho  experienced  pilot  it  was  easy.  In  many 
manouvers  the  situation  was  similar:  if  tho  cues  could  bo  recognized, 
tho  control  adjustments  presented  littlo  problem.  Apparently  for 
theso  maneuvers  tho  student's  proficiency  could  best  bo  measured  in 
terms  of  his  perceptual  ability. 

In  study  II  it  was  possible  to  administer  measures  to  students  with 
all  of  tho  instruments  in  tho  student’s  cockpit  covered.  With  instru¬ 
ments  covered  it  would  also  bo  possible  to  check  on  whether  or  not 
students  wero  performing  maneuvers  by  concentrating  too  much 
attention  on  instruments  during  tho  check  ride  at  tho  oxpense  of  keep¬ 
ing  a  sharp  lookout  outsido  tho  plane,  i.  o.,  whether  objective  measures 
wero  forcing  students  into  undcsirablo  mechanical  flying.  Three  dif¬ 
ferent  maneuvers  wero  used:  straight-ahead  climb,  straight-ahead 
glido,  and  straight-and-lcvcl  flight  at  an  estimated  altitude. 

In  tho  straight-ahend  climb  the  student’s  task  was  to  put  tho  plane 
into  tho  regular  climb  with  the  correct  air  speed  and  r.  p.  m.  With 
instruments  covered  the  student’s  cues  for  making  the  correct  settings 
wero  tho  anglo  between  tho  piano  nnd  tho  horizon,  tho  sound  of  tho 
engino  and  propeller,  tho  “stiffness”  or  “mushincss”  of  tho  controls, 
and  his  feeling  of  sustentation.  After  tho  student  had  set  tho  plane 
in  what  ho  believed  to  bo  tho  correct  climb,  bo  signaled  tho  check  pilot 
who  recorded  tho  air  speed  and  r.  p.  m.  Tho  student  was  scored  on 
his  deviation  from  tho  correct  values  as  read  from  uncovered  instru¬ 
ments  in  tho  check  pilot’s  cockpit. 

In  tho  straieht-ahead  glido  tho  student’s  task  was  to  sot  tho  plane 
in  a  straight  normal  glido  at  tho  correct  air  speed.  Tho  cues  for  this  - 
wero  tho  anglo  of  piano  and  horizon,  tho  sound  of  air  hissing  over  the 
struts  and  fabric,  and  tho  feel  of  tho  controls.  'In  this  maneuver  also, 
at  tho  student’s  signal,  tho  check  rider  recorded  tho  air  speed.  Tho 
scoring  was  in  terms  of  doviation  from  tho  correct  value. 


In  the  strnight-nnd-lcvcl  flight  maneuver  the  student’s  task  was  to 
glide  down  from  an  altitude  of  at  least  1,000  feet  nbovo  tho  ground 
and  level  ofT  at  500  feet  above  the  ground  at  cruising  air  speed  and 
r.  p.  m.  He  then  bad  to  fly  at  500  feet  above  the  ground,  straight 
and  level,  for  30  seconds.  This  involved  tho  student’s  judgment  of 
absolute  altitude  without  the  aid  of  an  altimeter  and  also  bis  judgment 
of  tho  air  speed  and  r.  p.  m.  at  cruising.  Sinco  this  test  was  carried 
out  in  level  country,  the  altitude  of  the  ground  was  tho  snmo  as  the 
altitude  of  the  landing  field  and  tho  check-pilot  could  tell  within  a 
small  error  bow  far  the  student  was  abovo  tho  terrain.  Tho  spccifio 
measures  were  in  terms  of  tho  deviation  of  the  estimation  from  tho 
correct  altitude,  air  speed,  and  r.  p.  m. 

Although  the  rationalo  for  tho  abovo  described  measures  scorned 
quite  good,  not  one  of  them  reached  tho  lowest  lovcl  of  significance  in 
differentiating  between  students  with  15  and  students  with  55  hours  of 
training.  Reliabilities  wero  low  in  most  cases.  Bccauso  of  a  small 
number  of  eliminations  for  flying  deficiency,  it  was  not  fcasiblo  to 
calculate  the  biscrial  correlations  with  graduation-elimination.  None 
of  these  measures  was  recommended  for  further  trial. 

Rudder 'Exercise  Stall 

In  tho  ruddcr-cxcrciso  stall  tho  check  rider  closed  tho  throttle, 
stalled  tho  piano  in  a  landing  attitude,  and  held  tho  stick  all  tho  way 
back  throughout  tho  maneuver.  Tho  student’s  task  was  to  maintain 
tho  piano  in  as  level  an  attitudo  as  possiblo  and  to  maintain  tho  some 
heading  by  use  of  tho  rudders  only  whilo  tho  piano  lost  500  foot  of 
altitude. 

Of  tho  three  measures  on  this  maneuver,  two  proved  ablo  to  discrim¬ 
inate  between  students  with  moro  and  fewer  hours  of  training. 
Oncof  these  was  tho  maximum  angle  of  the  wings  with  tho  horizon  during 
the  500-foot  descent.  In  tho  best  form  of  this  meosuro  tho  check  rider 
indicated  whether  the  student  allowed  tho  wings  of  the  piano  to  bank 
to  an  angle:  less  than  40°,  between  40°  and  C0°,  or  moro  than  00°. 
Tho  40°  and  GO®  angles  wero  conveniently  marked  on  tho  piano  by  tho 
angle  of  the  flying  wires  and  tho  angle  of  tho  cabnno  strut  respectively. 
Tho  other  good  measure  was  tho  maximum  directional  change  that  the 
student  allowed  tho  piano  to  mako.  This  was  judged  by  the  chock 
rider  to  bo:  less  than  22®,  between  22®  and  45®,  or  moro  than  46®. 
Tho  third  measure,  time  to  lose  COO  feet,  which  in  these  screening 
experiments  was  measured  with  a  stop  watch,  did  not  discriminate. 
In  this  mensuro  tho  longer  timo  was  tho  better  bccauso  if  the  student 
allowed  tho  piano  to  bank  up  steeply  on  ono  wing,  it  slipped  off  500 
feet  very  rapidly. 

Power-On  Stall 

In  tho  power-on  stall  recovery  tho  student  left  tho  throttle  At  • 
cruising  power  and  pulled  tho  noso  of  tho  plane  up  slowly  to  an  angle 
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greater  than  a  normal  climb.  As  tho  speed  decreased,  tho  piano  was 
held  in  the  same  attitude  by  increasing  back  pressuro  on  the  stick  and 
tho  wings  were  held  level  with  tho  rudder,  until  tho  piano  stalled.  In 
Primary  training,  the  plane  was  considered  stalled  when  the  ailerons 
wero  no  longer  effective.  When  tho  stall  occurred,  tho  student  lowered 
the  nose  rapidly  to  an  angle  steeper  than  tho  normal  gliding  anglo. 
With  the  forward  stick  motion  he  simultaneously  advanced  tho  throttle 
to  full  power,  and  as  soon  as  flying  speed  was  reached,  tho  piano  was 
returned  to  level  flight.  Tho  student's  principal  tasks  wero  to  stall 
the  plane  thoroughly  enough  so  that  the  ailerons  wero  stalled,  to  bring 
tho  throttlo  forward  with  tho  stick  in  recovery,  to  hold  the  wings 
level  with  tho  rudder,  and  to  return  to  cruising  speed  in  level  flight 
without  stalling  the  plane  again  or  diving  excessively  in  recovery. 

Of  the  four  measures  tried  out  on  this  maneuver,  two  seemed  worth 
further  development.  Tho  first  wa9  whether  tho  student  actually 
stalled  the  plane  as  indicated  by  tho  stalling  out  of  tho  ailerons.  The 
biscrial  correlation  with  graduation-elimination  for  this  measure  was 
0.38.  Tho  other  good  mcasuro  was  the  maximum  air  speed  in  recovery , 
in  which  tho  lower  tho  air  speed  tho  better  tho  scoro  bccauso  of  the 
poorer  student’s  tendency  to  divo  excessively.  This  predicted  gradu¬ 
ation-elimination  with  a  biscrial  coefficient  of  0.43.  Tho  poorer 
measures  wero  (1)  Time  in  seconds  ( measured  with  a  stop  watch)  Jrom 
forward  stick  until  plane  returned  to  level  flight,  and  (2)  Whether  the 
throttle  was  full  open  when  the  stick  vxis  pushed  forward  during  the 
recovery.  Although  both  of  theso  wero  important  aspects  of  stall 
recovery,  neither  showed  useful  validity  or  reliability. 

Spin  Recovery 

In  this  maneuver  tho  student’s  task  was  to  put  tho  piano  into  a 
normal  spin  and  then  to  begin  tho  recovery  procedure  by  application 
of  opposito  rudder  after  a  specified  number  of  turns.  After  an  addi¬ 
tional  one-quarter  to  one-half  turn,  tho  stick  was  moved  briskly  for¬ 
ward  beyond  tho  neutral  position.  This  control  position  was  held 
until  tho  piano  stopped  rotating  and  went  into  a  divo.  Tho  student 
then  neutralized  tho  rudder  and  pulled  tho  noso  of  tho  piano  up  into 
level  flight. 

Of  tho  threo  measures  of  this  maneuver,  two  wero  chosen  for  further 
test.  Tho  first  was  a  test  of  orientation,  whether  the  student  applied 
opposite  rudder  in  the  spin  within  22 0  of  the  specified  number  of  turns . 
Tho  other  was  a  measure  of  tho  maximum  speed  during  the  recovery 
dive.  In  tltis  measure  the  best  student  was  the  ono  who  had  tho  lowest 
air  speed  in  the  divo.  This  method  of  scoring  was  decided  on  bccauso 
tho  poorer  students  had  a  tendency  to  divo  excessively  and  to  take 
excessively  long  times  to  recover  into  normal  flight.  Tho  measure 
not  recommended  for  further  trial  was  tho  time  in  seconds  from  appli~ 
cation  of  opposite  rudder  until  the  nose  cuts  the  horizon.  Although  this 
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measure  had  fairly  good  predictive  power  for  graduation-elimination, 
in  practice  it  was  necessary  to  moasuro  this  timo  with  a  stop  watch, 
a  procedure  which  only  the  most  experienced  check-pilots  found  pos¬ 
sible,  so  that  the  measure  appeared  not  to  bo  suited  to  administration 
by  the  regular  check-pilots  or  instructors  in  Primary  school. 

Student’s  Perception  of  Procedures  in  Spin  Recovery 

On  the  hypothesis  that  the  student’s  nbility  to  pcrccivo  and  identify 
correctly  the  procedures  during  spin  recovery  was  an  important  aspect 
of  his  proficiency,  students  were  tested  on  their  observation  of  a  spin 
recovery  performed  by  tho  instructor.  Each  check  pilot  was  in¬ 
structed  to  spin  in  a  certain  direction  for  a  specified  number  of  turns 
and  then  to  perform  a  recovery  cither  correctly  (with  tho  ruddor  first 
and  then  the  stick),  or  incorrectly  (with  tho  stick  first  and  then  tho 
rudder).  Both  student  and  check  pilot  woro  given  score  shoots. 
Tho  instructor  recorded  what  ho  did  and  tho  student  recorded  what 
ho  perceived  tho  instructor  to  do.  Scoring  was  on  tho  basis  of  agree¬ 
ment  between  student  and  instructor  on  (1)  the  direction  oj  the  spin, 
(2)  the  number  oj  turns  before  application  oj  opposite  rudder,  (3)  whether 
stick  or  rudder  was  used  first  during  the  recovery.  Only  tho  degreo  of 
agreement  on  tho  number  oj  turns  proved  at  all  prcdictivo  of  gradua¬ 
tion-elimination.  Sinco  this  presumably  measured  orientation  in 
much  tho  snmo  way  as  tho  student’s  application  of  opposito  ruddor 
when  ho  performed  tho  spin,  this  perception  mensuro  was  not  added 
to  tho  list  recommended  for  further  study. 

Efficient  Flight  Planning 

According  to  flying  instructors  and  check  pilots  a  student’s  ability 
to  plan  and  cxccuto  a  sequcnco  of  maneuvers  was  an  important  part 
of  his  general  flying  proficiency.  Somo  students  did  not  plan  ahead 
while  they  were  performing  a  maneuver  and  consequently,  when  one 
maneuver  was  completed,  they  wero  rarely  ready  to  begin  tho  noxt. 
Other  students  were  nblo  to  plan  so  that,  for  examplo,  they  wero  near 
an  appropriate  road  at  tho  correct  altitudo  when  about  to  begin  S- 
turns  over  a  road,  or  could  finish  a  sequcnco  of  maneuvers  near  the 
landing  field. 

In  testing  this  ability,  a  sequcnco  of  10  maneuvers  was  prepared 
which  included  a  variety  of  problems.  Tho  student  was  instructed  to 
perform  theso  maneuvers  in  tho  regular  manner,  to  observo  tho  safoty 
precautions  directed  by  local  flying  regulations,  and  to  plan  and  exo- 
cuto  his  flight  so  as  to  completo  tho  check  rido  as  quickly  os  possible. 
Tho  student  knew  that  each  maneuver  was  graded  by  tho  check  rider 
so  that  no  maneuver  could  bo  slighted.  Tho  check  rider  recorded  tho 
duration  of  tho  flight  from  take-off  to  landing. 

Although  tho  tcst-rctcst  reliability  of  tho  timo  mcasuro  was  low,  tho 
average  of  tho  two  tests  correlated  0.48  with  later  graduation-elimino- 
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tion.  This  coefficient  was  based  on  only  30  graduates  and  8  eliminces, 
so  that  the  figure  can  bo  regarded  only  as  tentative,  although  a  positive 
coefficient  of  this  size  would  bo  expected  only  2.5  times  in  100  if  there 
wero  no  real  relationship  between  the  variables. 

FACTORS  INFLUENCING  TIIE  RELIABILITY  OF  MEASURES 

AT  PRIMARY  SCHOOLS 

In  tho  five  screening  studies  it  was  found  that  most  of  the  relia¬ 
bilities  were  low,  and,  as  shown  in  table  6.4,  there  was  no  correlation 
between  tho  reliability  and  validity  of  tho  measures.  Some  light  is 
thrown  on  tho  probable  causo  of  tho  low  reliabilities  by  an  analysis 
of  data  availablo  on  measures  of  tho  landing  maneuver  used  in  the 
Primary  section  of  a  largo-scalo  study  of  the  effects  of  additional 
training  on  flying  skill  (reported  in  chapter  10).  Three  aspects  of 
this  landing  manouver  were  measured:  the  sene  of  landing,  the 
attitudo  of  tho  piano  (3-point  or  whccls-first)  on  landing,  and  whether 
tho  student  dropped  in  or  bounced  more  than  3  feet.  Furthermore,  the 
student  was  given  a  zero  score  on  all  three  aspects  if  his  landing  was 
so  bad  that  tho  instructor  had  to  assist  him  in  order  to  prevent  on 
accident.  Experts  are  of  the  definite  opinion  that  landing  in  the 
proper  placo  in  tho  proper  attitudo  without  dropping  the  plane  in  or 
bouncing  it  involves  important  aspects  of  flying  skill,  namely,  the 
ability  to  judge  spneo  and  plan  a  course  through  it,  to  control  the 
attitudo  and  air  speed  of  tho  piano,  and  to  feel  whon  it  is  about  to  stall. 

A  study  of  observer  reliability  was  carried  out  on  152  students  in 
class  45-B  who  had  had  15  weeks  of  training  at  Curtis  Field,  Brady, 
Tox.  During  tho  last  week  of  this  Primary  training  the  students  wore 
given  two  successive  landings,  each  of  which  was  scored  by  on 
observer  on  tho  ground  as  well  as  by  tho  check  rider  in  the  plane. 
Tho  correlations  between  tho  scores  of  tho  ground  and  aerial  observers 
wero  determined  separately  for  tho  first  and  second  landings  and 
combined  by  tho  z-transformation,  yielding  a  coefficient  based  on  a 
total  of  304  pairs.  Tho  results  aro  presented  in  table  6.6. 

Test-retest  reliabilities  on  tho  landing  measures  wero  obtained  on 
a  total  of  170  primary  school  students  from  class  45-B  who  had 
completed  15  weeks  of  Primary  trnining.  Soventy  of  these  were 
from  Gamer  Field,  Uvalde,  Tex.,  and  100  from  tho  Wilson-Benfils 
Flying  School,  Chicknsha,  Okla.  Theso  students  wero  given  a  pair  of 
successive  landings  on  each  of  two  dnys.  The  landings  on  the  socond 
day  wero  with  a  different  check  pilot  and  in  a  different  plane.  The 
reliability  of  test  and  retest  in  immediate  succession  w^s  determined 
by  correlating  tho  two  landings  on  tho  first  day  with  each  other  and 
also  correlating  tho  two  landings  on  tho  second  day  with  each  other. 
Theso  two  6cts  of  correlations  wero  thon  combined  by  the  z-trans¬ 
formation  to  yield  a  coefficient  based  on  a  total  of  340  pairs.  Similarly, 


the  tcst-rctcst  reliability  on  different  days  was  determined  by 
correlating  the  first  landings  on  each  of  tho  two  days  and  also  the 
second  landings  of  each  of  tho  two  days.  Then  theso  coefficients  wero 
combined  by  tho  z-transformation,  yielding  a  correlation  based  on 
340  pairs.  These  results  arc  also  shown  in  table  6.6.** 


Table  6.0. — Reliability  of  landing  mtaturet  in  primary  training 


N 

Zone  of 
landing 

Landing 

attitudo 

Dropped 
or  bounced 

Observer  reliability  *  • . . . 

304 

0.83 

.13 

PH 

aw 

.33 

T.sl-rvti st  on  the  same  day  • . . 

340 

Tut -retest  on  different  day*  * . 

340 

.03 

Ba 

.00 

>  Blnco  scores  from  2  different  ground  observers  and  4ft  cheek  pilots  were  Involved  In  these  correlation*, 
they  represent  absolute  as  well  m  relative  agreement.  Furthermore,  there  wns  almost  perfect  agreement 
between  the  means  and  standard  deviations  of  the  scores  of  the  ground  and  alt  ob.vrvers. 

» Tlu  so  relatively  hlith  observer  reliabilities  agree  very  well  with  tlio.w  senired  for  most  measures  of  tba 
Advanc'd  Twin-Engine  Scilo  re|iortid  In  cha|iter  7.  The  obvrver  reliability  of  the  measure  of  son*  of 
landlns  In  the  twin-engine  scale  was  0.80  for  47  cases.  If  corrected  for  broad  categories,  theso  reliabilities 
would  approach  unity. 

*  A  calculation  of  the  correlation  between  the  two  landings  for  the  rest  of  the  Primary  schools  ‘avolved 
In  the  lartfe-scale  study  on  the  clb-cts  of  added  training  (a  total  of  1,400  eases)  confirms  these  figures.  Tho 
fell  tldlitli  s  v  bi  n  U-st  and  retest  follow  e.aeh  other  in  (he  same  check  ride  arc  0.13  for  touo  of  landing,  OJI 
for  landing  atlitude,  ami  n.3fi  for  bounce  or  dropt**!  In. 

*  Thise  very  low  reliabilities  when  the  test  and  retest  are  administered  In  different  planes  on  dUTerrnl 
days  ngrec  with  those  secured  for  lauding  measures  In  the  other  studies  described  In  this  chapter. 


Observer  Reliabilities  Are  High 

Tho  observer  reliabilities  aro  relatively  high,  ranging  from  0.79  to 
0.88.  Sinco  this  degreo  of  absoluto  agreement  was  achiovcd  by  the 
way  in  which  tho  measurements  were  defined  rather  than  by  specially 
training  tho  observers  in  comparing  their  estimates  with  each  other, 
it  seems  likely  that  tho  standards  used  ore  stablo  with  a  laigo  degree 
of  generality.  Thus,  theso  correlations  between  observers  indicato  tho 
objectivity  of  the  scoring  os  well  as  its  high  observer  reliability.  Since 
tho  scoring  directions  were  available  to  tho  students  as  woll  os  to  the 
check  pilots,  the  entire  process  of  measurement  may  bo  considered 
to  bo  relatively  objective. 

Reliabilities  from  Test  and  Retest  on  Same  Flight  Are  Low  But  Positive 

Tho  tcst-rctcst  reliabilities  of  two  immediately  successive  trials  on 
tho  same  check  rido  aro  constantly  lower,  ranging  from  0.12  to  0.32. 
Tho  agreement  between  tho  snmo  observer’s  scoring  of  two  imme¬ 
diately  succcssivo  landings  is  much  poorer  than  that  of  tho  two  ob¬ 
servers  scoring  tho  samo  landing.  Sinco  tho  observer  reliability  ie 
relatively  high,  tho  lower  tcst-rctcst  reliability  must  bo  produced  by 
conditions  which  introduco  variability  into  tho  actual  performance  of 
tho  test  rather  than  by  inaccuracy  in  scoring  tho  performance.  Those 
conditions  aro  probably  nrnuto-to-niinuto  fluctuations  in  wind  and 
turbulence  and  variability  in  tho  student’s  performance. 

■  The  two  studies  tod  tba  analysis  Involved  In  thli  table  were  designed  tad  supervised  by  MaJ.  W.  B. 
Mlllor. 
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Reliabilities  From  Test  and  Retest  on  Different  Days  Vary  About  Zero 

Tho  correlations  between  test  and  retest  on  different  days  are  still 
lower.  They  are  practically  zero.  These  rides  aro  on  different  days 
and  aro  by  different  check  pilots  in  different  planes.  The  high  ob¬ 
server  reliabilities  indicato  that  tho  chnngo  of  check  pilots  docs  not 
produce  a  great  effect  upon  tho  scoring  of  performance,  although  it 
might  influence  tho  student’s  confidence  slightly  and  hence  his  man¬ 
ner  of  performance.  Tho  instruments  of  different  planes  are  likely 
to  bo  more  or  less  out  of  calibration  and  various  planes  havo  somewhat 
different  flying  characteristics.  Other  factors  such  as  fluctuations  in 
tho  wind,  turbulence,  density  of  the  air,  and  other  weather  differences 
would  also  bo  expected  to  vary  moro  from  day  to  day  than  they 
would  within  tho  period  of  a  singlo  check  ride.  Variability  of  the 
wind  would  bo  expected  to  have  an  especially  important  effect  on 
landing.  Finally,  it  seems  likely  that  factors  within  tho  individual 
student  may  produco  some  variability  in  his  performance  and  that 
such  factors  may  vaiy  moro  from  day  to  day  than  within  a  single 
check  ride. 

Reliabilities  Within  a  Day  and  Between  Days  Compared  for  a  High- 

Altitude  Maneuver 

Correlation  between  maneuvers  on  the  same  check  ride. — In  studies  I 
and  III  a  left  steep  turn  and  a  right  steep  turn  wero  scored  separately 
on  each  of  tho  two  testing  days.  It  was  thus  possible  to  correlate  the 
altitude-range  scores  on  tho  left  steep  turn  and  the  right  steep  turn  on 
tho  same  day.  This  was  dono  separately  for  tho  first  day  and  the 
second  day  and  for  the  upper  and  lower  groups  in  studies  I  and  III. 
These  correlations  were  then  combined  by  tho  z-transformation  and 
yielded  a  correlation  of  0.38,  based  on  332  pairs  of  turns. 

Correlation  between  maneuvers  on  diferent  days. — For  tho  between- 
days  correlation,  tho  nltitudo  rango  in  tho  left  steep  turn  on  the  fimt 
day  was  correlated  with  the  altitude  rango  on  tho  right  turn  on  the 
second  day,  and  tho  right  turn  on  tho  first  day  was  correlated  with  the 
left  turn  01  the  second  day.  A  combination  by  tho  z-transformation 
of  theso  cori  Motions  yields  a  coefficient  of  0.17,  based  on  332  pairs  of 
turns.  * 

Within  a  tiny  and  between  days  compared. — Tho  correlation  between 
turns  on  tho  sumo  day  was  0.38  and  between  turns  on  different  days 
was  0.17.  Under  tho  conditions  of  this  experiment  a  difference  of 
this  size  would  bo  expected  by  chance  less  than  1  timo  in  100.  This 
differenco  was  probably  tho  result  of  tho  different  planes  used  on  the 
two  days  and  changes  in  turbulence,  ns  well  ns  day-to-day  variability 
in  the  students’  performance. 

It  seems  unlikely  that  tho  difference  was  tho  result  of  variability 
among  tho  check  riders.  Since  the  Primary  trainer  has  room  foi*  only 
two  people,  tho  student  and  tho  check  rider,  it  was  not  possiblo  on  this 
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high-altitude  maneuver  to  obtain  the  correlations  between  the  scoring 
of  two  different  observers.  However,  in  a  study  reported  in  chapter 
7,  two  different  observers  read  the  same  set  of  instruments  during 
altitude-control  maneuvers  in  the  B-25  (Mitchell).  The  observer 
reliability  on  these  altitude-control  measures  ranged  from  0.57  to 
1 .00.  Since  this  was  very  probably  also  true  for  observations  of  altim¬ 
eters  in  Primary  trainers,  observer  error  was  not  likely  to  bo  a  large 
factor  in  the  above  difference  in  reliabilities. 

Assumptions  Involved  in  Conventional  Tcst-Rctcst  Reliability  May  Not 
Apply  to  Flying  Measures 

In  measuring  flying  ability,  a  low  test-retest  reliability  might  easily 
result  from  the  inexperienced  student's  observation  of  his  own  errors 
on  the  fust  test  and  consequent  correction  of  these  errors  on  the  retest. 
According  to  instructors'  reports,  in  n  given  maneuver  including  two 
mensurable  tasks  the  student  pilot  was  often  unnblo  to  perform  both 
tasks  at  the  same  time.  On  the  first  test  he  might  fail  in  ono  of  tho 
measured  tasks  and  vote  his  error.  On  the  retest  he  corrects  this 
error  but  fails  on  the  other  measured  task.  If  a  number  of  students 
did  this  on  a  given  measure,  the  test-retest  correlation  for  individual 
measures  would  be  considerably  reduced  and  might  approach  zero. 
However,  for  these  measures  the  sum  of  scores  on  test  and  retest  might 
correlate  well  with  graduation-elimination,  sinco  students  who  per¬ 
formed  well  on  both  test  and  retest  had  better  scores  than  thoso  who 
failed  on  ono  or  both. 

The  fact  that  correlations  between  maneuvers  performed  in  iinrno- 
diato  succession  on  the  same  check  ride  were  higher  than  correlations 
between  maneuvers  on  different  days  seems  incompatible  with  tho 
ideas  of  tho  preceding  paragraph.  This  correction  during  tho  retest 
of  errors  made  on  the  original  test,  while  it  has  been  reported  by  in¬ 
structors,  might  not  occur  frequently  enough  to  affect  tho  correlation. 

Implications  for  Further  Work 

Both  landings  and  steep  turns  were  very  important  parts  of  tho 
task  of  all  pilots.  According  to  experts,  tho  variables  measured  in 
theso  scales  were  very  relevant  aspects  of  thoso  maneuvers.  This 
study  showed  that  the  difficulty  of  measuring  these  aspects  was  nioro 
the  result  of  factors  introducing  variability  in  performance  from  day 
to  day  than  of  errora  in  measuring  any  given  samplo  of  performance. 
Landings  were  probably  especially  susccptiblo  to  variablo  conditions, 
such  as  gustincss  of  wind,  which  changed  tho  performance  from  day 
to  day.  Steep  turns  do  not  seem  likely  to  bo  moro  susccptiblo  than 
tho  average  maneuver  and  it  is  believed  that  similar  results  w’ould 
bo  secured  with  many  other  types  of  measures. 

Tho  fact  that  the  correlation  between  measures  administered  on 
different  days,  in  different  planes,  and  by  different  check  ridoro  was 
considerably  lower  than  that  between  tests  given  in  immediate  suo- 
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cession  in  tho  samo  plane  by  the  same  check  rider  has  important  prac 
tical  implications.  Two  different  procedures  should  bo  used  for  two 
different  situations: 

(1)  In  measuring  tho  results  of  training  experiments  it  is  important 
to  control  the  effects  of  conditions  of  testing  by  giving  check  rides 
to  matched  pairs  of  experimental  and  control  subjects  as  nearly  in 
succession  as  possiblo  in  the  same  plane  by  the  samo  check  pilot;  and 

(2)  If  a  number  of  rides  aro  being  given  to  increase  tho  reliability 
of  the  measures  on  the  same  student,  theso  should  be  given  on  differ¬ 
ent  days  in  different  planes  by  different  check  pilots  in  order  to  cancel 
out  as  much  ns  possiblo  tho  effects  of  the  variablo  conditions. 

It  should  bo  noted  that  reliabilities  determined  with  test  and  retest 
in  immediate  succession,  by  the  samo  check  rider  or  in  the  same  plane, 
probably  will  considerably  overestimate  tho  results  that  can  bo 
expected  in  any  practical  application  of  tho  measures  tested. 

Ono  of  the  most  practicable  ways  of  coping  with  the  factors  produc¬ 
ing  day-to-day  variability  probably  is  to  repeat  tho  measures  on  & 
number  of  different  days.  Theso  studies  have  shown  that,  in  general, 
single  administrations  do  not  produce  sufficiently  rcliablo  results. 

RELIABILITY  OF  OBJECTIVE  MEASURES  WITH  REPEATED 

ADMINISTRATIONS  . 

Purpose  '* 

Sinco  most  of  tho  reliabilities  and  many  of  tho  validities  of  objective  1 
measures  in  tho  screening  studies  were  extremely  low,  it  was  decided  > 
to  givo  repeated  doily  administrations  of  a  check  ride  in  an  effort  to  { 
obtain  higher  reliabilities  and  validities.  Because  it  was  desired  not 
to  interfere  with  training,  tho  tests  were  administered  by  each  stu¬ 
dent's  own  instructor  and  tho  check  rido  was  necessarily  mado  up  of 
measures  on  maneuvers  that  wero  performed  on  most  of  tho  flights 
during  tho  early  part  of  training.  The  only  maneuvers  certain  to  be 
performed  on  every  flight  during  tho  early  part  of  training  were  tako- 
off,  traffic  pattern,  and  landing.  On  these  maneuvers  it  was  possible 
to  tiy  out  somo  18  measures,  most  of  them  objective.  Some  appar¬ 
ently  less  objective  measures  were  also  included  with  tho  thought  that 
methods  of  making  them  moro  objective  might  bo  suggested  in  the 
courso  of  tho  experiment. 

Procedure 

Study  VI  *•  was  conducted  at  Uvoldo  and  Brady  Primary  Schools. 
In  it  tho  items  wero  administered  every  day  on  which  thcro  was  a 
dual  rido  from  tho  sixth  through  tho  thirtieth  hours  of  training.  Tho 
tests  wero  administered  each  day  to  73  students  by  tho  students'  own 
instructors.  An  averago  of  12  administrations  per  student  was  ob- 

*•  Study  VI  vu  don«  it  •  tlmt  when  flying  rtudenta  without  ornxu  rerelce  or  prertoui  flying  uperlfnca 
wero  (till  being  trained  In  Prime  tt  echooU.  Tbo  itudtcs  are  grouped  logically  rather  than  chronologically. 
Tbue,  the  Itcm-eoilyili  itudlri  are  numbered  I  through  V  and  the  special  etudlea  on  reliability  and  Inter* 
correlation  are  numbered  VI  and  VU. 
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turned.  Since  the  same  instructor  gave  all  of  tho  12  administrations 
of  the  test,  the  odd-even  reliability  from  these  data  might  bo  spuriously 
high.  In  order  to  obtain  an  estimate  of  this  possible  spurious  riso  in 
reliability,  arrangements  were  made  in  planning  tho  experiment  to 
have  each  student  tested  at  approximately  the  sixteenth  hour  by  an¬ 
other  instructor.  This  administration  by  the  other  instructor  was 
called  tho  “switch-rido.” 

In  order  to  obtain  an  estimate  of  the  reliability  of  tho  measures 
when  they  were  administered  by  different  instructors,  tho  switch-rido 
results  were  correlated  with  the  seoros  given  by  tho  regular  instructor 
on  the  previous  day.  They  were  also  correlated  with  those  given  by 
tho  regular  instructor  on  the  following  day.  Thus  there  wero  two 
correlations  between  the  scores  given  by  tho  “switch”  and  tho  regular 
instructors.  Theso  two  correlations  combined  by  tho  z-transforma- 
tion  technique  gave  the  best  possible  estimate  of  the  tcst-rctcst  relia¬ 
bility  of  a  single  administration  of  theso  measures  when  test  and 
retest  were  given  by  different  instructors.  These  figures  aro  shown  in 
column  1  of  tablo  6.7. 


Table  6.7. — Odd-even  relinbilitiei  for  It  adminiitrationt  by  tame  cheek-rider  com¬ 
pared  with  reliabilitiei  when  different  check  riders  were  uted  (N—73) 


1  4 

*• 

Si 

<*#• 

6* 

r  (14)  (3.4) 

•  • 
raw 

grad -alia 

VI-Al.  Continuous  application  of  throttle  In  take-off. 

a  <5 

aot 

aio 

a  71 

aw 

VI-A2.  Deviation  of  plane  from  straight  path  during 
take-off  roll .  . 

-.03 

p) 

.90 

.66 

.a 

VI-A3.  A/S  reading  when  plane  leaves  ground . 

.34 

.66 

.66 

.16 

.06 

VI-A4.  I'lano  pulled  off  ground,  held  on  ground,  or 

Down  off  correctly..  . . 

VI-AS.  A/S  range  In  climb  to  first  turn . 

10 

.74 

94 

.79 

•  79 

.  19 

.74 

.64 

.76 

.W 

VI-A6.  Plane  drift  during  climb . 

-.13 

(») 

.17 

.11 

.69 

VI-A7.  Altitude  deviation  from  300  feet  during  Orst 

turn..  .  . . . 

.94 

.79 

.93 

.W 

.IT 

VI- III.  Traffic  fiattcm:  Enters  downwind  leg  In  mid¬ 
dle  third.  ..  . . 

-.10 

P) 

.83 

.71 

.a 

VI-112.  Traffic  pattern:  Maximum  deviation  from 
allitudo  of  600  feet  In  pattern  from  entry  till  throttlo 

Is  cut .  .  . 

.01 

.33 

.93 

.79 

.99 

VI-113.  Final  approach:  A/S  range  front  beginning  of 
last  tum  unld  student  lieglns  to  break  glide . 

.11 

.71 

.93 

.91 

.69 

V1-H4.  Traffic  pattern:  Tum  onto  approach  leg 
started  300  fret  or  oIioto . 

-.07 

(*> 

.71 

.64 

.66 

.97 

VI-115.  Final  approach:  After  throttle  closed  mom 

power  not  neci  saary.  or  added  as  required . 

VI-116.  Final  approach:  Maintains  glide  tmek  paral¬ 
lel  with  T..... . ...... 

.30 

86 

.61 

.a 

.00 

.61 

.W 

.a 

.39 

VI-H7.  Oround  contact:  landed  In  crab . 

.13 

.M 

.73 

.66 

.39 

VI-H8.  Oround  contact:  Landed  drifting . 

.00 

.64 

.83 

.76 

.64 

VI-113.  I.undlng  attitude:  Smooth  3-polut.  tall  Orst, 
wheels  first,  3-i>olnt  tut  dropped  tn  3  feet  or  mom. . 

.07 

.47 

.79 

.69 

.» 

Vl-nio.  Plane  bounced . 

-.01 

<*> 

.M 

.73 

.W 

Vl-iut.  Placo  of  contact:  Goal,  first  >t  of  field. _... 

-.13 

P 

.97 

.64 

-.a 

1  r.w-,...— ' This  correlation  la  a  s-tranjfomiatlon  combination  of:  fl)  The  correlation  between  results  from 
the  "switch-ride"  administered  by  a  different  Instructor  at  approximately  the  lab  hour  of  training  and  the 
results  of  the  frretding  duy's  lest  ride  hy  the  student's  regular  Instructor;  nnd  (2)  The  correlation  bclweoa 
tho  same  "s»  itch-ride"  and  the  /(Coir hi#  day's  ride  hy  the  student's  regular  Instructor. 

•c'....,,—' The  figure  In  column  1  was  then  corrected  hy  the  Su-arman-llrown  formula  to  estimate  tho 
reliability  of  I2adn  tnlstmtlons.  Negative  reliabilities  were  considered  meaningless  and  wire  not  corrected. 

*  This  corn  hit  Ion  Is  lutween  the  average  of  A  odd  and  the  atemre  of  (levin  administrations  of  each 
measure,  corrected  by  tho  Spearman-Drown  formula  to  ottmnte  the  nil  ihdlly  of  all  12  administrations. 

‘c*(l  .3)  (2.1).—’ This  correlation  Is  the  odd-even  correlation  with  hours  held  constant  for  the  aeern-oof  th# 
odd  scons  nnd  tho  averago  of  tho  even  scores  hy  the  setnln.irtUI  eumhllon  formula  described  tn  the  test. 
Tho  oorrehtlons  necr.vary  for  entering  this  formula  are  shown  In  tha  appendix. 

•raugrad-cllm.— The  correlation  Is  hetwren  rr.ul-ellni  In  rrimary  school  and  the  sum  of  four  toft  ad> 
ministrations  for  each  measure  between  the  eighth  and  eleventh  hour*  of  I'rlmary  training.  There  were 
U  graduated  and  30  eliminated  fur  Dying  deficiency. 
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Result*:  Agreement  of  Measures  by  Same  Instructor  Compared  With 
That  of  Measures  by  Different  Instructors 

When  the  reliabilities  involving  tho  switch  rido  were  corrected  by 
the  Spearman-Brown  formula  to  estimate  the  reliability  of  12  rides, 
they  could  he  compared  with  the  corrected  odd-even  reliability  of 
the  12  rides  given  by  the  regular  instructor.  Tho  two  sets  of  values 
arc  shown  in  columns  2  and  3  of  tablo  6.7. 

As  would  be  expected  when  the  test  and  retest  were  given  by  differ¬ 
ent  instructors  (column  2),  this  moro  rigorous  procedure  reduced  a 
general  drop  in  the  reliabilities.  In  comparing  the  corr  ons  be¬ 
tween  the  different  instructor  and  the  regular  ono  show  wlumn 
2  of  table  6.7  with  the  odd-even  correlations  for  the  12  administra¬ 
tions  given  by  the  regular  instructor  in  column  3,  it  was  found  that 
in  all  but  two  instances  the  values  in  column  2  were  smaller  than  or 
equal  to  those  in  column  3.  It  may  bo  inferred  that  tho  measures 
which  showed  the  biggest  drop  in  reliability  are  the  ones  on  which  the 
two  instructors  had  the  most  different  standards  and  that  theso  were 
the  least  objective  items.  With  only  73  cases  in  this  study  and  the 
fact  that  the  switch-ride  correlations  were  based  on  only  two  trials 
caeh,  some  of  these  differences  may  be  produced  by  chance.  Of  tho 
six  measures  with  the  negativo  correlations,  VI-A2,  VI-AG,  VI-Bl, 
Vl-Bt,  VI-BIO,  and  VI-Bl  1,  tho  first  two  wero  on  observations  which 
wero  particularly  hard  to  make  objectively.  In  VI-A2  tho  check 
pilot  had  to  judge  whether  during  tho  take-off  roll  the  piano  deviated 
from  tho  straight  path: 

Not  at  all. 

One  wing  length  (approximately  15  feet). 

One  plane  width  (approximately  30  feet). 

Over  ono  plane  width.  • 

In  VI-AG  the  check  pilot  had  to  make  the  same  judgment  during  the 
straight-ahead  climb  to  300  feet  after  take-off.  Since  at  Primary 
schools  most  of  the  take-offs  wero  from  grass,  without  a  runway  for 
a  reference  either  on  the  ground  or  in  tho  take-off  climb,  the  judgment 
was  difficult  and  allowed  minimal  possibilities  for  common  standards 
among  pilots.  The  other  four  measures  with  negativo  correlations 
seemed  more  likely  to  be  objective.  It  is  possible,  of  course,  that  some 
or  all  of  the  six  negative  coefficients  were  tho  result  of  chance  factors. 

Results:  Effect  of  Holding  Hours  Constant  in  the  Odd-Even  Correlation 

Tho  odd-even  correlations  for  tho  12  test  administrations  by  the 
regular  instructor  aro  shown  in  column  3  of  table  6.7.  Bocauso  it 
was  not  possible  in  the  test  situation  to  control  tho  hour  lovels  on  the 
successive  administrations  it  was  necessary  to  correct  this  odd-oven 
reliability  for  tho  different  averago  hours  of  training  of  tho  various 
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students.  Tho  students  varied  in  the  number  of  hours  of  flying 
preceding  any  given  test  administration  for  two  reasons: 

(1)  Because  of  variations  in  the  weather,  attendance,  etc.,  somo 
students  had  more  flying  periods  than  others  and  thus  consistently  had 
more  hours  at  each  administration  of  the  test; 

(2)  Some  students  were  ready  to  solo  with  fewer  hours  of  training, 
accumulated  hours  of  solo  between  the  dual  check  rides  and  thus  had 
more  hours  of  flying  experience  at  each  later  tost  administration. 

The  fact  that  different  students  had  somewhat  different  numbers  of 
hours  of  flying  instruction  increased  tho  range  of  skill  represented 
in  the  population  and  thus  raised  somewhat  the  estimates  of  reliability. 
It  should  be  noted  that  measures  which  were  so  unreliable  that  they  did 
not  measure  anything  would  not  be  affected  by  this  increase  in  rango; 
it  would  not  make  an  unreliable  measure  seem  reliable  but  only  mako  & 
reliable  one  seem  more  reliable. 

It  seemed  desirable  to  get  somo  cstimato  of  the  effect  upon  tho 
reliabilities  of  the  fact  that  hours  of  training  were  not  held  completely 
constant.  In  order  to  obtain  the  odd-even  correlation,  with  hours 
held  constant  for  both  odd  and  even  average  scores,  it  was  necessary 
to  partial  out  hours  in  both  the  odd  scores  and  even  scores.  This  was 
accomplished  by  a  semi-partial  correlation.* 

Whilo  the  odd-even  correlation  without  holding  hours  constant  gave 
an  estimate  of  reliability  somewhat  higher  than  it  would  if  hours  could 
have  been  held  constant  experimentally,  tho  semi-partial  technique 
gave  too  low  an  cstimato.  This  occurs  because  tho  relationship 
between  hours  and  skill  had  two  aspects: 

(1)  The  student  who  had  more  hours  had  more  chance  to  improve 
their  skill  through  practice.  This  was  the  relationship  that  had  to  be 
removed  before  a  fair  estimate  of  reliability  could  be  obtained. 

(2)  The  students  with  more  aptitude  soloed  sooner  and  thus, 
because  of  their  greater  aptitude,  had  more  hours  on  tho  averngo  on 
later  test  administration.  To  the  extent  that  tho  greater  number  of 
hours  was  indicative  of  greater  aptitude,  the  semi-partial  correlation, 
in  which  hours  were  held  constant,  gave  too  low  an  cstimato  of  odd- 
even  reliability. 

Although  the  semi-partial  correlation  overcorrectcd  to  somo  extent, 
tho  reduction  when  hours  were  held  constant  was  not  large,  as  can  b© 
seen  from  column  3  and  4  in  table  G.7.  This  means  that  although  it 
was  impossible  to  hold  the  number  of  hours  of  flying  training  com¬ 
pletely  constant  for  all  students  in  this  study,  it  did  not  linvo  any 
very  great  effect  on  tho  results. 

•  r(u)  (a  .^a=2@j£3&*!^ 

Vl-rWl-'Si 

la  which:  Variable  1-<x)d  score,  variable  2-even  (core,  variable  }-odd  hour*,  variable  4-even  boon, 

J.  P.  Guilford,  Ptjthemrtrit  MtlMi,  McOrew.UlU  Hook  Co.  I  or.,  IBM.  pace*  WJ  and  404,  formula  Dumber 
(UM). 
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Results:  Prediction  of  Graduation  Elimination 

In  the  five  screening  studies  it  was  possible  to  determine  the  predic¬ 
tive  power  of  the  measures  tried  out  by  correlating  the  sura  of  tho  test 
and  retest  administrations  with  subsequent  graduation  or  elimination 
from  Primary  school.  It  seemed  probable  that  the  sum  of  theso  two 
administrations  would  be  more  reliable  than  the  singlo  administration 
on  either  the  test  or  retest.  This  seemed  likely  not  only  bccauso  of 
the  increased  length  but  also  because  the  sum  of  the  two  administra¬ 
tions  on  different  days  with  different  planes  and  check  riders  would 
tend  to  average  out  theso  sources  of  day-to-day  variability. 

In  the  present  experiment  in  which  students  were  tested  every  day 
on  which  there  was  a  dual  ride  from  the  sixth  through  tho  thirtieth 
hour  of  training,  the  four  test  administrations  during  tho  eighth 
through  tho  eleventh  hours  were  chosen  to  be  summed  and  correlated 
with  subsequent  Primary  graduation-elimination.  These  four  were 
chosen  for  the  following  reasons:  (1)  Beforo  the  eighth  hour  tho  stu¬ 
dents  had  so  little  flying  experience  that  objective  tests  would  not 
measure  their  skills  adequately;  (2)  After  the  eleventh  hour  tho  num¬ 
ber  of  eliminations  increased  rapidly  with  a  consequent  restriction  of 
proficiency  range  in  tho  population;  and  (3)  Students  recommended 
for  elimination  in  Primary  schools  received  an  averago  of  approxi¬ 
mately  four  independent  check  rides  beforo  elimination,  so  that  if  an 
objective  check  ride  were  accepted  for  use  in  Primary  schools,  four 
administrations  would  be  administratively  feasible. 

Column  5  in  table  G.7  shows  the  biserial  correlation  with  Primary 
school  graduation  for  the  sum  of  four  administrations  of  each  measure 
between  tho  eighth  and  eleventh  hour  of  flying  training.  Of  thoso 
18  measures,  12,  or  G7  percent,  were  higher  than  0.41,  compared  with 
10  percent  of  the  graduation  elimination  biscrial  correlations  for  tho 
04  measures  in  the  fivo  screening  studies  that  were  reported  in  tablo 
0.4.  Sinco  these  biscrial  coefficients  are  based  on  53  graduates  and 
20  climinces,  for  the  14  highest  of  theso  18  coefficients  there  was  only 
1  chance  in  200  of  obtaining  positivo  coefficients  ns  largo  as  theso  if 
there  had  been  no  relationship  between  tho  variables. 

These  coefficients  indicated  tho  predictive  power  of  theso  measures 
when  tho  measures  were  administered  four  times  by  the  student’s  own 
instructor.  The  coefficients  indicated  a  useful  degreo  of  predictive 
power  when  administered  in  this  way  in  the  early  part  of  Primary 
training.  However,  it  should  bo  kept  in  mind  that  tho  values  ob¬ 
tained  are  high  possibly  bccauso  tho  student’s  instructor  usually  made 
the  initial  recommendation  for  elimination  beforo  the  student  received 
independent  elimination  check  rides  by  threo  members  of  tho  super¬ 
visory  staff. 

There  remained  tho  problem  of  whether  similar  predictive  power 
could  be  obtained  if  objcctivo  measures  were  administered  four  times 
with  a  different  check  rider  on  each  test,  a  suitable  procedure  if  tho 
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objective  measures  were  to  be  used  ns  a  regular  part  of  tho  flying  tests 
given  to  students  proposed  for  elimination  during  Primary  training. 
Arrangements  wero  made  for  such  a  trial  of  a  check  rido  mado  up  of 
objective  measures,  but  tho  end  of  tho  war  and  tho  consequent 
changes  in  training  made  this  impossible.  Such  a  check  rido  and 
the  objective  measures  for  use  in  it  arc  described  in  tho  last  section  of 
this  chapter. 

INTERCORRELATIONS  AMONG  PRIMARY  MEASURES  IN  TIIE 
LARGE-SCALE  INVESTIGATION  OF  EFFECTS  OF  ADDED 
FLYING  TRAINING 

Purpose  and  Procedure 

It  was  desirablo  to  obtain  intorcorrclations  of  tho  measures  tried 
in  the  item-analysis  studies  but  the  small  number  of  students  tested 
in  any  given  study  and  the  low  reliabilities  of  tho  measures  mado  it 
inappropriate.  Tho  first  opportunity  to  obtain  intcrcorrelationa 
appeared  when  1,400  students  wero  tested  in  tho  Primary  section  of  a 
lnrge-scalo  study  of  tho  effects  of  additional  training  on  flying  skill. 
Other  details  of  this  study  aro  reported  in  chapter  10,  but  sinco  tho 
intcrcorrclations  aro  relevant  to  the  present  discussion,  they  will  bo 
presented  hero.  In  tho  sequence  of  Primary  studies  this  was  counted 
as  study  VII.41  The  1,400  students  tested  on  13  measures  had  re¬ 
ceived  15  weeks  of  Primary  training.  Each  student  was  tested  by  an 
instructor  (other  than  his  own)  who  had  been  carefully  briefed  on 
the  methods  of  scoring. 

Results 

Tho  intcrcorrclations  of  tho  13  measures  are  shown  in  tablo  6.8. 
None  of  the  intcrcorrclations  between  measures  on  different  maneuvers 
was  over  0.12,  with  the  exception  of  tho  correlation  of  0.21  between 
tho  Loop  and  the  Immflmann,  which  aro  relatively  similar  maneuvers. 
Those  low  intcrcorrclations  were  probably  for  tho  most  part  tho  result 
of  tho  low  reliabilities  of  the  single  administration  of  each  measure. 
Unfortunately  it  was  not  possible  to  correct  most  of  tho  intcrcorrcla¬ 
tions  for  attenuation  because  tho  only  reliability  values  available 
(except  on  landings)  were  for  test  and  retest  on  different  days.  These 
day-to-day  values  were  lower  than  tho  test-rctcst  correlations  within  a 
day,  as  seen  in  tablo  0.6,  and  would  ovcrcorrect  for  attenuation  if 
applied  to  intcrcorrclations  for  measurer  given  on  tho  somo  day. 

Measures  within  a  single  maneuver  have  higher  intercorrelations.— 
Somo  of  tho  intcrcorrclations  among  tho  measures  within  a  given 
maneuver  wero  considerably  higher.  Theso  higher  correlations  within 
a  maneuver  might  havo  been  produced,  however,  by  tho  fact  that 

a  Study  VII  tu  don*  •(  •  time  when  fly  In*  itudentt  without  over***!  terrier  or  prarioui  flying  tip*- 
Hence  were  itlll  being  trained  In  Primury  tcho'-l*.  At  fitted  In  footnote  P,  Iht  primary  itudie*  art  grouped 
logically  ntber  than  chronologically  la  thlt  chapter. 
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there  were  simple  physical  causal  relationships  between  different 
aspects  of  the  airplane's  behavior.  This  seemed  moro  likely  than 
the  occurrence  of  common  elements  in  the  human  abilities  involved. 
The  clearest  example  of  a  purely  physical  causal  relationship  was  in 
the  correlation  between  Attitude  on  landing  and  Bounced  or  dropped  in. 
If  the  Stearman  plane’s  landing  attitudo  was  tail  high  or  slightly 
wheels  first,  it  hit  the  ground  while  it  still  had  flying  speed  and  then 
as  the  shock  of  hitting  the  ground  threw  tho  tail  down,  tho  piano  roso 
into  the  air  again,  as  a  result  of  the  sudden  incrcaso  in  angie  of  attack 
of  tho  wings.  This  is  clearly  shown  in  the  correlation  of  0.63  between 
Attitude  and  Bounced  or  dropped  in  for  the  first  landing  and  0.58  for 
tho  second  landing.  This  is  further  substantiated  by  tho  fact  that 
the  correlations  for  Attitude  on  the  one  landing  and  Bounced  or  dropped 
in  on  tho  other  are  only  0.17  and  0.19.  Tho  correlations  between 
these  measures  on  the  same  landing  and  on  different  landings  are 
shown  in  tablo  6.9. 

It  will  be  noted  in  table  6.9  that  tho  correlations  between  Area 
plane  touches  and  Attitude  and  also  tho  correlations  between  Area  plane 
touches  and  Bounced  or  dropped  in  were  higher  within  tho  samo  landing 
than  for  different  landings.  Tho  relationship  was  not  as  strong  in 
these  two  aspects  of  landing  but  still  remained  higher  within  tho  samo 
landing.  If  a  student  was  going  to  overshoot'  tho  area,  ho  may  have 
tried  to  put  tho  piano  down  too  soon  and  made  a  landing  in  a  Whcels- 
first  attitude,  which  in  turn  produced  a  bounce.  If  tho  student  saw 
that  he  was  not  quite  going  to  reach  the  desired  area,  ho  may  have 
tried  to  hold  the  plane  off  the  ground  too  long,  stalled  it  too  high,  and 
dropped  in  moro  than  3  feet. 

Reliabilities  of  test  and  retest  in  immediate  succession  for  tho  three 
measures  in  landing  were  shown  to  be  0.13  for  Area  plane  touches, 
0.2S  for  Attitude,  and  0.26  for  Bounced  or  dropped  in.  In  a  further 
study  it  was  planned  to  give  administrations  of  each  mcasuro  on  four 
or  more  successive  days.  Under  these  conditions,  test-retest  relia¬ 
bilities  and  intercorrelations  should  bocomo  moro  meaningful. 

Reliability  and  Validity  of  a  Total  Check-Ride  Score 

One  method  of  obtaining  greater  reliability  in  a  homogeneous  test 
is  by  increasing  the  length.  Although  a  check  ride,  mado  up  of  a 
number  of  different  measures,  is  not  homogeneous,  tho  intcrcorrela- 
tions  between  the  various  measures  nro  for  tho  most  part  positive,  so 
that  tho  total  scoro  for  a  number  of  measures  on  tho  samo  chock  rido 
should  be  somewhat  more  reliable  than  tho  averago  reliabilities  of  tho 
individual  measures.  Of  tho  24  measures  in  study  I,  tho  16  measures 
were  chosen  which  best  differentiated  between  students  with  55  hours 
of  training  and  thoso  with  15  hours  of  training.  Tho  scores  on  these 
16  measures  were  equally  weighted  and  tho  test-retest  reliability  of 
the  total  score  was  then  calculated  separately  for  the  55-hour  group 
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and  tho  15-hour  group.  The  biscrial  correlation  with  graduation- 
elimination  was  also  calculated  for  tho  15-hour  group.  Theso  results 
aro  shown  in  tablo  6.10. 

It  should  bo  noted  that  tho  biscrial  correlation  with  graduation- 
elimination  is  based  on  the  sum  of  tho  scores  for  tho  two  administra¬ 
tions  on  successive  days.  This  validity  coefficient,  then,  should  be 
compared  with  the  corrected  reliability  coefficient  in  tho  second  col¬ 
umn  rather  than  tho  simplo  test-retest  reliability  shown  in  tho  first 
column.  It  should  bo  noted  that  tho  measures  wero  not  selected  on 
cither  of  tho  bases  compared  but  on  their  ability  to  differentiate 
betw  een  students  w  ith  moro  and  fewer  hours  of  training. 


Tadi.k  0.9. — Correlations  between  the  same  measures  during  a  single  landing  and 

on  immediately  successive  landing 


Same 

landing 

Different 

landlnp 

Area  plane  touches  (first  versus  second  landing*) . . 

ps  i  n.  is 

Landing  nttlludo  (first  versus  second  landings)  . 

'S3 

.28 

llounccd  or  dropiml  in  (flrst  and  second  landings) . 

.28 

Ana  versus  nlliliida .  . 

rq  tdai 

8T  .28 

PT 

.08 

Area  versus  nltltuda . . 

ft 

.10 

Area  versus  bonnet . 

Pit  .29 

.11 

Area  versus  bounce . 

BU  .27 

8R 

.08 

Altitude  versus  bounce  . 

OR  .83 
TU  .68 

.17 

Attitude  versus  bounce . 

.10 

•  The  letters  In  tills  table  correspond  In  the  Identifying  letters  on  the  measures  In  tnhlo 
T8  Is  the  lesl-ntcst  reliability  for  area  piano  touches;  PQ  Is  the  correlation  between  area 
landing  attitude  for  the  first  landing,  an»l  ST  Is  tho  correlation  between  tho  &tmo  variables  for  tho  second 
landing:  I'T  is  the  correlation  between  area  on  tho  flrst  landing  and  attltudoon  tho  socond  and  8Q  between 
area  on  tho  m-ooud  and  attitude  on  the  first,  eta. 


Table  0.10. — Reliability  and  validity  of  total  score  on  16  measures  in  study  / 


N 

rif 
test- 
re  test 

dir' 

double 

length 

rsi. 

grad-ellra  $. 
sum  of  1 
administrations 

Upper  class  (44  hours) . 

4! 

0.60 

0.87 

n  a  >3 

Lower  dots  (14  hours) . . . . 

34 

.30 

.64 

•  Pieornmn  Urown  estimate  of  tho  reliability  of  the  sum  of  the  scores  on  tost  nnd  retest  together. 

•  Not  calculable  because  no  students  In  this  group  were  eliminated  In  primary  school  after  tba  fiftieth 
hour  of  Dying  training. 


8.8.  For  example, 
plane  touches  ana 


RECOMMENDED  FURTHER  INVESTIGATION  Of 
SELECTED  MEASURES 


Plan  of  Experiment 

It  was  planned  to  investigate  further  tho  measures  which  seemed 
most  promising  in  all  of  tho  seven  studies  described  up  to  this  point. 
Sinco  most  of  theso  measures  wero  used  in  a  singlo  test  and  retest  and 
given  to  a  relatively  small  number  of  students,  their  rosults  were  not 
highly  rcliahlo  statistically.  They  wero  tho  first  coarse  screening  of 
tho  measures.  Tho  next  study  was  to  bo  a  finer  nnd  more  definitive 
screening.  In  order  to  mako  each  mcasuro  moro  rclinblo,  it  would  bo 
administered  on  four  successive  check  rides  at  each  of  two  levels  of 
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training.  These  check  rides  would  bo  administered  to  a  larger  num¬ 
ber  of  students  in  order  to  sccuro  statistically  moro  stablo  results. 

The  following  types  of  data  were  to  bo  secured  on  each  mcasuro: 
(1)  ability  to  predict  graduation-elimination,  (2)  ability  to  discrimi¬ 
nate  between  groups  of  students  with  different  amounts  of  flying  train¬ 
ing,  (3)  reliability  of  odd  versus  even  administrations,  and  (4)  inter- 
correlations  with  other  measures.  Tho  first  two  types  of  data  would 
indicate  tho  power  of  each  mcasuro  for  tho  two  different  possible  uses; 
the  third  would  help  to  indicato  whether  any  lack  of  power  i3  due  to 
unreliability.  The  intcrcorrclations  would  show  whether  or  not  cer¬ 
tain  measures  overlap  so  much  that  some  of  them  should  bo  omitted 
to  avoid  needless  duplication  and  would  also  throw  somo  light  on  tho 
naturo  of  Hying  skills.  Finally,  a  comparison  of  tho  first  two  types  of 
data,  secured  more  reliably,  would  indicato  tho  extent  to  which  it 
might  be  necessary  to  develop  two  somewhat  different  scales  of  flying 
skill,  one  to  measure  those  aspects  which  aro  tho  result  of  aptitudo,  and 
another  to  measure  those  aspects  which  aro  tho  result  of  learning. 

It  was  planned  to  gather  these  data  by  administering  a  check  rido 
of  selected  measures  to  100-150  students  each  day  for  4  days  from 
the  eighth  through  the  eleventh  hour  of  training.  Each  test  adminis¬ 
tration  would  bo  by  a  different  check  rider  in  a  different  piano  and 
results  from  tho  4  days  were  to  be  averaged  to  obtain  tho  most 
reliable  mcasuro  of  the  students*  ability  at  this  level  of  training.  Tho 
same  procedure  with  the  samo  check  rido  was  to  be  followed  for  4 
successive  days  at  a  higher  level  of  training,  between  tho  thirtieth  and 
fortieth  hours  of  primary  flying.  It  was  planned  to  test  tho  entire 
class  at  the  ono  remaining  Primary  school,  using  from  20-30  specially 
trained  check  riders  under  the  supervision  of  members  of  tho  Primary 
Training  Advisory  Board. 

These  students  were  to  bo  tested  at  tho  8-1 1  hour  level  and  again  at 
the  30-40  hour  level.  In  this  way  it  would  be  possible  to  comparo  tho 
samo  group  at  two  different  levels  of  its  training.  Any  students  who 
would  lmvo  been  eliminated  between  tho  first  and  second  testing 
periods  would  bo  kept  in  school  for  tho  purposo  of  this  comparison. 
Proper  authority  was  secured  to  postpono  theso  eliminations  which 
wero  not  immediately  essential  to  safety  until  after  tho  second  period 
of  testing.  Tho  correlation  with  graduation  elimination  would  bo 
obtained  on  tho  samo  group  used  to  determino  tho  ability  of  tho 
measures  to  discriminate  hours  of  training  so  that  a  direct  comparison 
could  bo  made  between  theso  two  different  criteria. 

This  study  became  impossible  when  tho  end  of  tho  war  brought  a 
sharp  reduction  in  primary  training.  Tho  only  students  being  trained 
in  Primary  schools  wero  bombardier  and  navigator  officers  returned 
from  combat  who  hod  had  varying  amounts  of  incidental  pilot  train¬ 
ing  in  courso  of  flying  their  combat  missions.  Such  training  as  con¬ 
tinued  was  also  severely  disrupted  by  tho  rcleaso  or  transfer  of  in- 
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structors,  supervisory  personnel,  and  many  of  tho  students.  It  was 
concluded  that  further  studies  should  not  bo  conducted  until  condi- 
tions  became  moro  settled  and  possibly  not  until  cadet  training  was 
again  instituted. 

Bases  for  Selecting  the  Measures  , 

With  tho  information  gained  from  the  first  coarse  screening  of  the 
various  measures  described  in  the  preceding  sections  of  this  chapter, 
it  was  now  possiblo  to  select  better  measures  for  a  moro  rigorous  trial 
on  a  larger  number  of  students.  Tho  principal  bases  for  the  selection 
of  theso  measures  were  as  follows: 

(1)  Suitability  jor  use  at  the  8-1 1  hour  level. — From  an  examination 
of  the  results  of  the  seven  Primary  school  studies,  from  the  distribution 
of  elimination  at  the  various  hour-levels  and  from  the  pattern  of  intro¬ 
duction  of  new  maneuvers  in  Primary  schools,  it  was  decided  that  the 
8-11  hour  level  was  tho  best  time  to  administer  an  over-all  check  ride. 
By  tho  eighth  hour  the  fundamental  maneuvers  had  been  introduced 
and  practiced  so  that  measures  of  these  maneuvers  could  be  used.  In 
order  to  bo  suro  that  the  measures  would  bo  tested  on  their  ability  to 
discriminate  fundamental  skills  rather  than  on  tho  moro  transient 
factor  of  tho  opportunity  of  tho  students  to  be  exposed  to  tho  maneuver 
involved,  all  of  tho  measures  used  were  to  deal  with  maneuvers  with 
which  tho  student  was  already  familiar,  though  not  yet  skilled,  after 
8  hours  of  flying  training. 

(2)  Comprehensiveness. — It  was  dcsirablo  to  have  a  set  of  maneuvers 
and  measures  which  tested  all  of  tho  fundamental  skills  of  flying. 
This  was  true  not  only  bccauso  a  comprehensive  set  of  measures  was 
moro  likely  to  bo  diicriminativo  but  also  bccauso  a  check  rido  which 
emphasized  only  a  few  of  tho  important  measures  would  leave  the  way 
open  for  coaching  by  instructors  who  wero  preparing  students  to  pass 
such  a  cheek  ride.  The  ideal  check  ride  measures  all  of  tho  important 
aspects  and  only  tho  important  aspects.  An  instructor  who  coached 
his  students  for  such  a  check  rido  would  then  bo  utilizing  his  instruc¬ 
tional  timo  most  efficiently. 

(3)  Ilcliability. — If  a  mensuro  had  validity  enough  to  predict 
graduation-elimination  or  to  discriminate  between  groups  with  differ¬ 
ent  amounts  of  training,  it  must  have  had  enough  reliability  to  measure 
something.  If  it  was  highly  reliable,  it  may  or  may  not  have  had 
validity.  Therefore,  when  suitablo  criteria  wero  available,  validity 
was  a  moro  important  basis  for  choosing  measures  than  reliability. 
Relatively  littlo  weight  was  given  to  reliability  in  choosing  tho  meas¬ 
ures  for  this  study.  When  tests  of  validity  aro  available,  separate 
measures  of  reliability  aro  chiefly  useful  in  indicating  whether  low 
validities  aro  the  result  of  tho  irrelcvanco  of  tho  thing  measured  or 
whether  they  aro  tho  result  of  tho  unreliability  of  the  measure.  In  the 
latter  coso,  tho  low  validities  may  bo  raised  by  improving  tho  rclia- 
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bility  through  steps  such  as  controlling  variable  conditions  or  admin* 
istcring  more  trials. 

(4)  Validity. — The  two  kinds  of  vaMdity,  ability  to  predict  gradua¬ 
tion-elimination  and  ability  to  discriminate  between  students  with 
different  amounts  of  flying  training,  were  both  considered^  selecting 
measures.  As  described  in  the  preceding  section,  it  was  planned  to 
investigate  further  the  relationship  between  these  apparently  different 
tests  of  the  measures.  If  there  is  substantially  a  zero  correction 
between  ability  to  predict  graduation-elimination  and  ability  to  dis¬ 
criminate  hour  levels,  it  will  be  desirable  to  construct  separato  check 
rides  for  the  two  purposes.  For  those  reasons  it  was  important  to 
include  in  this  study  measures  with  both  kinds  of  validity. 

Measures  Selected  for  Further  Trial 
According  to  plan  the  following  maneuvers  and  measures  wero 
diosen  and  the  form  prepared  for  use  in  tho  next  trial  check  ride. 

1.  Take-Off,  Climb,  and  First  Torn 

A.  Application  or  Throttle  Doiuno  Take-Off  Roll: 

(2) . Smoothly  opens  throttle  to  full  position. 

(1)  . Not  opened  full,  uneven,  or  rammed. 

B.  At  Take-Off,  Student: 

(2)  . Lets  piano  fly  off. 

(1) . Pulls  plane  off  tho  ground. 

(1) _ ...  Holds  plane  on  ground. 

C.  A/S  Ranoe  From  20  Ft.  to  Level-Off: 

Check  niaiiEST  and  lowest  A/8. 

«-  55  60  65  70  75  80  85  DO  -» m.  p.  h. 

I  l  l  l  l  l  l  l  I 

08716433 

D.  Altitude  Ranoe  During  FinsT  Torn: 

Check  highest  and  lowest. 

Lcss-Fcct  300  ft.  More-Feet 

«-  100  80  60  40  20  20  40  60  80  100  -» 


01  2  345  6  789  10  / 


2.  Two  300*  Steep  Turns 

(Roll  directly  front  left  turn  Into  right  turnj 

A.  Deviation  From  Startino  Altitudb: 

CuECK  HIGHEST  AND  LOWEST.1  • 

Lose -Feet  *  Gain-Feet 

♦- 120  100  80  60  40  20  0  20  40  60  80  100  120  -♦ 

I  i  l  l  i  i  i  . . 

0126460780  10  11  13 


•  Scoring:  Highest  score  Is  0  points  for  range  In  icro  Interval;  1  point  subtract*  1  for  each  SO  fret  of  rang* 
so  that  check  In  galu  20  and  lose  CO  givos  score  of  4.  No  score  below  tero.  Clmller  scoring  for  all  rang* 
items. 

•  Marking:  0-+IO  to  -10;  20-11  to  30;  40-SI  to  40,  oto. 

703322—47 - 12 
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D.  Conditions  Tc  De  Fulfilled:  Failure  in  Either  or  These  Means  Zero 
Scons  on  Whole  Maneuver. 

1.  Reached  a  GO0  Bank  in  Each  Turn  (Cabane  Strut  Parallel  With 
Horizon). 

Yes  No 


1  0 

2.  Final  Roll-Out  Within  ±45*  of  Starting  Headino. 

Yes  No 


1  0 


S=  - — S  -  3BESS -  —  1  -  - ■  t 

3.  Power-On  Stall  Recovery 


A.  Stalled  Ailerons.  Yes  [ 

No  f 

2 

1 

B.  Maximum  Ain  Speed  in  Recovery: 

♦-  G5 

70  75  80  85  00  95 

100 

105  -* 

1  l  1  l  l  l  1  1 

0 

8  7  6  5  4  3 

2 

1 

4.  Rudder-Exercise  Stall 

i 

A.  Maximum  ‘ 

of  Wings  Durino  500  Feet: 

(3)  .... 

i  than  40*  (40®  =>  angle  of  flying  wires  and  horizon). 

(2)  .... 

..  40*  to  GO*  (GO®  *=  angle  of  cabane  strut  and  horizon). 

0)  . 

..  more  than  60* 

i 

B.  Maximum  Directional  Change  During  500  Feet: 

(3)  .... 

.  less  than  22*. 

! 

i 

(2)  ..... 

..  22*  to  45*. 

i 

i 

(1)  ..... 

..  more  than  45*. 

•  | 

5.  Spin  Recovery 

i 

Spin  to  Left 

i 

A.  Did  Student  Applt  Rudder  at  IX  Turns  Within— 

(2)  .... 

..  less  than  22*  either  way. 

i 

(1) 

..  22*  or  moro  either  way. 

i 

B.  Maximum  Air  8peed  in  Dive: 

,  i 

i 

«-  100 

105  110  115  120  125  130  135 

140 

145  -t 

l  l 

i  i  i  i  i  I  T 

I 

“| 

9 

8  7  6  5  4  3  2 

1 

o 

6.  Four  180*  Glidino  Turns 

' 

(With  medium  bonk) 

A.  First  Turn  (Left) 

. 

A/S,  Check  Higuest  and  Lowest 

*-  55 

GO  65  70  75  80  85  00 

05 

100  -♦ 

i  i  i  nn _ _  i  i  i  i  i 

0 

1  2  3  4  6  6  7 

8 

9 
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B.  Second  Turn  (Right) 

A/S,  Check  Highest  and  Lowest 


«-  55  60  65  70  75  80 

85 

00 

05 

100  -* 

1  i~ 

|  | 

0  1  2  3  4  5 

TniRD  Turn  (Left) 

A/S,  Check  Highest  and  Lowest 

6 

7 

8 

9 

55  60  65  70  75  80 

85 

00 

05 

100  -♦ 

1  1 

|  | 

1  1 

I  | 

1  1 

0  1  2  3  4  6 

Fourth  Turn  (Right) 

A/S,  Check  Highest  and  Lowest 

6 

7 

8 

9 

«-  55  60  65  70  75  80 

85 

00 

05 

100  -o 

0123456789 


7.  Simulated  Forced  Landino 

(In  SeM  approx.  H  mU*  aquan) 

A.  From  1,200  Ft.  Directly  Above  Specified  Field,  Goino  Down  who 
A/S,  CHECK  niOHEST  and  lowest. 

«-  65  60  65  70  75  80  85  00  05  100  -♦ 


r  i~t~t 


TT  T 


0  12  3  4 

B.  Student  Simulates  Das'?  Leg 


8 


Yes  No 


Upwind  Crosswind  Downwind 

I  I  I . ~l 


C.  Student  Comes  In 


D.  Student  Would  Have  Landed  in  Field 

In  first  2/3  Outsido  first  2/3 

I 


1 


8.  Two  Complete  S-Turns 

(Over  crow  wind  road) 

A.  Altitude  Deviation  in  all  Four  Loops  Together 

Check  greatest  deviations  above  and  below  btartino  altitudm 

Losc-Fcct  Gsin-Fcct 

«-  100  80  60  40  20  0  20  40  60  80  100  -* 


CZT 


. . — I 


B.  Duration  or  Each  Downwind  and  Upwind  Loop  in  Two  Complete 
S-Turns. 

Position  of  clock  second  hand  each  time  piano  crosses  road: 

Downwind  Upwind 

1st  loop  2d  loop 

Beginning  _  _ 

End  _  _ 

Time  In  seconds  - 


3d  loop 


4th  loop 


Score 


End  _ _ 

Time  in  seconds  _________  _______  - 

Total  time  in  seconds  _ —  ” _ 

C.  Student  Attempts  Semicircular  Ground-Pattern  in  Eacii  Loop: 

Yes  No 


Time  of  Day 


Wind  Velocity 


9.  Traffic  Pattern  and  Final  Approach 

A.  Fnou  Entrt  Into  Traffic  Until  Throttle  Is  Cut,  Altitude  Range: 
Check  highest  and  lowest 

Ix*ss-Fcct  More-Feet 


♦“  100  80  GO  40  20  500  20  40  GO  80  100  -♦ 


0  12  3  4 

B.  Air  speed  in  Final  Glide 

Check  highest  and  lowest 
—  55  60  65  70 


6  7  8  9  10 


80  85  90  95 


987654321 

C.  Changed  Final  Approach  Course  or  S’d  To  Hit  Correct  Lin» 

Yes  No 


1  2 

D.  After  Throttle  Is  Cut: 

(3) . No  power  added. 

(2) . Student  added  power  by  himself. 

(1) _ Instructor  told  Btudent  to  add  power,  or  instructor  added 

power. 


10.  Place  and  Manner  or  Ground  Contact 

A.  Place  or  Landino: 

Middlo  Outer  Not  in 

Zone  Zone  Zones 
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D.  Attitude  on  Landino: 

Smooth 

3-polnt 


Wheels 

First 


3-Point  and 
Dropped  in 
3  ft.  or  more 


C.  Bounce  on  Landino: 

Not  at  all  Lens  than  3  ft.  3  ft.  or  more 


w  ■/  > 


T>.  Instructor  Assists 


No  Yes 


3  1 


SUMMARY 

Primary  school  was  a  crucial  phaso  of  pilot  training.  In  Primary 
most  students  received  their  first  flying  instruction,  becamo  familiar 
with  tlio  fundamental  maneuvers  of  flight,  and  exhibited  their  aptitude 
or  lack  of  it.  Of  the  total  number  of  eliminations  for  lack  of  flying 
proficiency  in  Primary,  Basic,  and  Advanced  schools,  considerably 
moro  than  half  occurred  at  the  Primary  level.  Definite  objective 
standards  were  particularly  desirable  in  Primary  to  select  those  stu¬ 
dents  whoso  skill  warranted  further  training  and  to  eliminate  at  an 
early  stage  thoso  students  who  would  not  bo  able  to  meet  tho  high 
requirements  of  combat  flying.  For  theso  reasons  tho  Primary  phase 
was  chosen  for  intensive  investigation. 

Tho  first  task  in  developing  objective  measures  of  flying  skill  was  to 
select  tho  critical  aspects  of  tho  various  training  maneuvers  and  to 
devise  relevant  an  ’  comprehensive  objective  measures  for  them.  For 
31  maneuvers,  or  parts  of  maneuvers,  256  measures  were  devised  and, 
after  consultation  and  preliminary  trial,  tho  131  best  and  most  prac¬ 
ticable  of  theso  were  tried  out  in  Primary  schools  on  groups  from  45 
to  90  students  who  had  not  had  previous  flying  training.  For  each  of 
tho  measures,  information  was  obtained  on  (1)  reliability  of  test  and 
rotest  on  different  days,  (2)  validity  in  differentiating  between  students 
with  moro  and  fewer  hours  of  training,  and  whero  possiblo,  (3)  validity 
in  terms  of  the  ability  of  measures  to  predict  subsequent  graduation 
or  elimination  from  Primary  school. 

Positivo  correlations  significant  at  the  2.5  percent  lovel  or  above 
were  obtained  for  approximately  35  percent  of  tho  reliabilities.  This 
level  of  significance  was  also  reached  by  25  percent  of  tho  correlations 
indicating  ability  to  discriminate  between  groups  with  different 
amounts  of  training  and  15  percent  of  thoso  indicating  ability  to  pro-  • 
diet  subsequent  graduation  or  elimination. 
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Tho  measures  which  on  tho  first  day  of  testing  were  the  best  at 
discriminating  between  students  with  different  amounts  of  training 
were  also  best  on  the  second  day  of  testing.  There  seemed  to  bo  no 
relationship,  however,  between  the  ability  of  measures  to.  discriminate 
between  students  with  different  amounts  of  training  and  their  ability 
to  predict  graduation-elimination.  The  seeming  independence  of 
those  two  types  of  validity,  under  tho  conditions  of  this  experiment, 
suggested  that  it  may  bo  necessary  to  construct  ono  typo  of  scale  for 
measuring  the  results  of  training  experiments  and  another  somewhat 
different  ono  for  discriminating  between  students  with  different 
amr  ants  of  aptitude. 

A  special  analysis  was  mado  of  the  reliability  of  certain  repre¬ 
sentative  -measures.  One  of  these  was  range  of  altitude  deviation  in  a 
high  altitude  maneuver,  a  steep  turn.  Three  others  dealt  with  an 
important  low  altitude  maneuver,  an  accuracy  landing.  These  were 
zone  of  landing,  landing  attitude,  and  bounced  or  dropped  in.  On  all  of 
these  measures  it  was  found  that  when  test  and  retest  were  given  on 
different  days  in  different  planes  by  different  check  riders,  tho  relia¬ 
bility  was  much  lower  than  when  test  and  retest  were  given  in  imme¬ 
diate  succession  in  tho  same  piano  and  by  tho  samo  check  rider. 
From  this  result  two  conclusions  were  drawn:  (1)  in  any  check  ride 
used  to  measure  tho  results  of  training  experiments,  it  is  important 
to  control  tho  effects  of  conditions  of  testing  by  measuring  matched 
pairs  of  experimental  and  control  subjects  as  nearly  in  succession  os 
possible  in  the  samo  piano  and  by  the  samo  check  rider;  (2)  if  a 
rclinblo  mensuro  of  tho  individual  student  is  desired,  check  rides 
must  bo  repeated  on  a  sufficient  number  of  days  in  different  planes 
by  different  check  riders  in  order  to  average  out  tho  effect  of  variations 
in  conditions  of  testing  and  of  possible  fluctuations  in  the  individual's 
ability  to  perform. 

As  a  further  step  in  this  analysis,  tho  three  objective  measures  on 
tho  accuracy  landing  were  scored  by  two  independent  observers,  ono 
in  tho  piano  and  ono  on  tho  ground.  Tho  correlations  botwcon  the 
scores  by  tho  two  independent  observers  wero  found  to  be  relatively 
high,  ranging  from  0.70  to  0.88.  From  this  it  was  concluded  that 
tho  low  tcst-rctcst  reliabilities  wero  produced  not  so  much  by  errors 
in  measurement  as  by  variations  in  tho  performance  measured. 
Theso  variations  probably  resulted  from  ohanges  in  turbulence,  tem¬ 
perature,  and  other  characteristics  of  tho  air,  differences  in  planes  and 
check  riders,  and  fluctuations  in  tho  student's  ability  to  perform. 

Ono  way  of  counteracting  this  variability  was  to  give  repeated 
administrations  of  tho  tests  so  that  variablo  errors  were  more  likely 
to  averago  out.  In  a  special  experiment  tho  student's  own  instructor 
graded  him  on  objective  measures  each  day  that  a  dual  ride  was 
.  taken  from  tho  sixth  to  tho  thirtieth  hour  of  training.  It  was  found 
that  useful  graduation-elimination  validities  were  obtained  from  the 
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sum  of  four  administrations  of  objective  measures  between  the 
eighth  and  eleventh  hours  of  training.  Repeated  administration  also 
raised  the  reliabilities  to  useful  levels  when  theso  administrations 
were  made  by  the  student’s  own  instructors.  Tho  problem  remained 
of  applying  a  more  rigorous  test  and  finding  whether  adequately  valid 
and  reliable  measures  could  be  obtained  if  four  successive  adminis¬ 
trations  were  mado  by  different  check  riders  on  different  days  in 
different  planes. 

A  final  experiment  was  prepared  in  which  27  selected  objective 
measures  were  to  bo  given  to  150-200  Primary  students  in  4  consecu¬ 
tive  daily  administrations  between  the  eighth  and  eleventh  hours  of 
training,  with  each  administration  by  a  different  check  rider.  For 
each  measure  a  determination  was  to  be  made  of  the  odd-cv  m  relia¬ 
bility  of  the  four  trials  and  also  of  the  ability  of  tho  total  score  on 
these  trials  to  predict  graduation  or  elimination  from  Primary  school. 
Another  four  administrations  between  tho  thirtieth  and  fortieth 
hours  of  training  were  planned  in  order  to  determine  the  ability  of 
the  selected  objective  measures  to  discriminate  between  students  with 
more  and  fewer  hours  of  training.  It  was  planned  to  compnro  tho 
effectiveness  of  each  measure  in  discriminating  between  students  with 
different  amounts  of  training  with  its  ability  to  predict  pass-fail  in 
order  to  determine  whether  theso  two  criteria  are  similar  or  different. 
Finally,  intercorrclations  between  the  measures  wero  to  bo  calculated 
for  tho  purpose  of  eliminating  those  which  duplicated  each  othor, 
and  also  to  throw  light  on  tho  structure  of  flying  skill.  It  was  im¬ 
possible  to  perform  this  Anal  experiment  because  of  tho  end  of  tho 
war  and  tho  consequent  changes  in  training  activities. 

Tjio  proposed  final  check  ride,  containing  tho  most  reliablo  and 
valid  objective  measures  chosen  from  tho  seven  Primary  studies,  is 
presented  in  this  chapter.  Tho  Pilot  Project  recommended  this 
experiment  os  tho  next  step  in  developing  objcctivo  measures  of 
flying  skill  at  tho  Primary  level. 


CHAPTER  SEVEN 


Measures  of  Two-Engine  Flying 
Skill  (Contact) 

Capt.  Stanford  C.  Erickscn 


INTRODUCTION 

Use  of  Two-Engine  Planes  in  the  Training  Command 

The  use  of  two-engine  aircraft  in  the  Training  Command  began  in 
1941  when  small,  selected  groups  of  students  wero  given  instruction 
in  the  Lockheed  Hudson  and  the  B-18  prior  to  graduation.  By  1944 
the  majority  of  students  wero  being  graduated  from  two-engino 
schools  where  they  received  10  weeks  training  in  tho  TB-25  Mitchell 
bomber.  As  late  as  1941  it  would  lmvo  appenred  extremely  radical 
to  propose  that  a  piano  with  tho  power,  speed,  weight,  and  tactical 
characteristics  of  the  B-25  could  bo  used  successfully  os  tho  standard 
Advanced  two-engine  trainer.  This  transition  was  tho  result  of  a 
number  of  contributing  factors:  (1)  The  tremendous  need  for  multi* 
engine  pilots  to  fly  the  larger  combat  and  transport  aircraft,  (2)  better 
methods  of  pilot  training,  (3)  improved  pilot  selection,  and  (4)  tho 
fact  that  the  use  of  tactical  typo  aircraft  at  the  advanced  level  mate¬ 
rially  improves  pilot  proficiency  and  shortens  the  precombat  training 
required  for  two-engine  pilots. 

Advantages  of  Multicnginc  Aircraft  for  Research 

Multiengino  aircraft  offer  nt  least  two  distinct  advantages  for 
doing  research  in  tho  area  of  pilot  evaluation:  (1)  Tho  instructor  sits 
beside  the  student  instead  of  in  a  separate  cockpit  and  can  observo  in 
greater  detail  the  quality  of  the  student's  performance,  (2)  there  is 
space  for  a  second  observer  to  fly  and  make  independent  observations 
of  pilot  performance. 

Because  of  these  advantages,  a  series  of  exploratory  studies  wero 
made  in  this  area.  On  the  basis  of  the  experience  gained  in  these 
studies,  tho  decision  was  mado  to  concentrate  further  work  at  the 
Advanced  level  of  training  on  developing  and  testing  tho  objective 
measures  of  instrument  flying  skill  which  aro  described  in  tho  next 
two  chapters.  Tho  four  preliminary  studies  on  tho  measurement  of 
two-engino  contact  flying  skill  arc  reported  in  this  chapter. 
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STUDY  1:  RELIABILITY  AND  VALIDITY  OF  A 
SUBJECTIVE  CHECK  RIDE  u 


The  Pilot  Project,  working  cooperatively  with  the  two-engine  group 
at  the  Central  Instructors  School,  constructed  a  more  detailed  and 
analytical  rating  scale  than  the  ono  normally  used  for  grading  stu¬ 
dents.  This  check  ride  covered  the  more  important  maneuvers  in¬ 
cluded  in  the  two-engine  Instructors  School  curriculum.  This  sub¬ 
jective  check  ride  provided  the  initial  opportunity  for  the  Pilot  Project 
to  apply  reliability  and  validity  item  analyses  to  the  problem  of  meas¬ 
uring  (lying  skill. 

Procedure 

After  a  preliminary  try-out  of  items,  a  rating  scalo  of  94  “rated 
work  sample"  items  was  constructed.  Sixty-nine  student-instructors 
in  the  two-engine  group  wcrcchcckcdat  two  different  times  by  separate 
rntors,  with  an  intervening  interval  of  from  2  to  4  days.  Tho  raters 
w  ere  the  20  most  experienced  check  pilots  in  the  tw'o-cngino  group  and 
had  never  flown  with  the  students  before.  Each  officer  mado  an 
originnl  rating  of  approximately  four  students  and  also  made  the 
rcchcck  of  about  four  students  previously  graded  by  one  of  tho  other 
rating  officers.  Tho  ratings  were  made  after  approximately  15  hours 
of  flying  instruction  at  tho  Central  Instructors  School. 

The  Scale 

There  wero  14  different  maneuvers,  each  ono  composed  of  2  to  9 
items.  Theso  are  listed  in  table  7.1.  Tho  normal  landing  maneuver 
is  a  good  examplo  of  tho  measures  composing  tho  scale.  Tho  check 
pilots  wero  told  to  cncirclo  tho  appropriate  word  or  number,  with 
“1"  low  and  “5”  high.  Tho  importance  of  “spreading"  tho  ratings 
was  emphasized. 


Normal  Landing: 

Turn  onto  approach . 1  2  3  4  5 

Glide .  1  2  3  4  5 

Gear  check  on  approach . . . No  Yea 

Roundout  and  landing . 1  2  3  4  5 

Landing  roll .  1  2  3  4  5 

Smoothness  on  controls . . .  1  2  3  4  6 

Trimming . 1  2  3  4  5 

After-landing  check  correct . . . No  Yes 

Had  to  go  around  bccauso  of  overshooting. . Yes  No 


Result* 

Tho  product-moment  tcst-rctcst  reliabilities  for  tho  individual 
items  wero  found  to  rango  from  0.00  to  0.20.  For  items  marked 

*>  Lt.  Cut  Charles  M.  Wharton,  Commondh*  Officer,  Two-Enfiiw  Group,  Central  Instructor*  School, 
Randolph  Field,  encourajtcd  this  research  tod  made  available  tho  facilities  of  tho  Two-En*tn#  Group  Is t 
8tudl<s  2  and  3  described  In  this  chapter.  Capt.  A.  T.  Oordon,  Research  Officer,  Two-En*lM  Oroup, 
assisted  tn  tho  construction  and  administration  of  tho  chock  ridrs  used  In  Studios  3  and  2.  8/Sft.  O.  P. 
Oorahenson  and  S/S* t.  Walter  W.  Ismael  mado  the  statistical  analyses  for  both  projects. 

166 


cither  “yes”  or  “no,”  the  tetrachoric  correlations  indicate  reliabilities 
as  high  as  0.58. 

The  scores  on  tho  sepnrato  measures  were  added  together  to  obtain 
a  total  score  on  each  of  the  14  maneuvers.  Tho  reliability  coefficients 
of  these  maneuver  scores  ranged  from  0.00  to  0.40,  with  tho  exception 
of  one  maneuver,  forced  landing,  which  was  —0.29.  Tho  reliability 
of  the  total  scoro  was  0.25. 

Using  instructors’  final  grades  as  tho  criterion,  validity  coefficients 
were  obtained  for  the  results  of  tho  two  rides  separately.  These 
values  ranged  from  —0.06  to  0.41.  The  validity  for  tho  total  chcck- 
rido  score  (sum  of  all  maneuver  scores)  for  the  two  rides  was  0.39  for 
the  first  ride  and  0.29  for  tho  second. 

In  tablo  7.1  arc  the  reliability  and  validity  coefficients  and  signifi¬ 
cance  levels  for  each  maneuver  scoro  and  the  total  chcck-rido  score. 


Tanir,  7.1. — Reliability  and  validity  coefficients  for  each  maneuver  in  the  rated  work 

sample  check  ride 

[N -69] 


Maneuver 

Number  of 
llcma 

Text-re  tent 
reliability 

Validity » 

Starting  . 

4 

*0. 31 

trt  Rid* 

an 

14  PM* 
an 

Taxiing . 

TaVe-olT  .  . . . 

8 

oil 

.13 

-.08 

Climb  and  level-oil . , . 

rower-olT  (tails . 

Slow  flying  . . . 

4 

8 

8 

.14 

'*.39 

*.2J 

•*.38 

•*.24 

M4 

•.33 

•.30 

.13 

8 

•14 

.04 

••*.41 

Kin  flic-on  pin*  stall . - . 

4 

.10 

•*.24 

8 

-.39 

.03 

.09 

7 

.03 

••*.33 

*.33 

Normal  landing . 

t 

s 

••*.40 
•*.  34 

••.34 

.13 

•••.40 

.04 

Single-engine  landing . . . 

• 

3 

*.  21 
.01 

•••.33 

-.02 

Ml 

.00 

•4 

*•.24 

•••.39 

•*.39 

■  Correlation  with  flail  grade. 

Th«  one.  two,  or  three  intrrlsks  Indlrnte  the  statistical  rlgnlAoinre  ol  these  rorfllrieala.  If  tber*  wer  no 
relationship,  |>osltlv«  coeflHIonh  as  large  ns  these  would  be  eijiecU-d  by  chance: 

(No  asterisk) -more  than  10  Hines  In  100. 

•-I0  times  In  100 or  lee*. 

••-2.4  times  In  100  or  lea*. 

•••■0.4  times  In  100 or  lest. 


Conclusion 

This  form  of  subjcctivo  grading  system  in  which  tho  detailed 
specific  aspects  of  pilot  performance  arc  scored  separately  holds  somo 
promise  for  uso  within  any  given  training  station.  Tho  merit  of  this 
type  of  scalo  is  limited  to  its  use  only  under  conditions  where  tho  work 
of  the  check  pilots  can  bo  continually  standardized  and  their  sub¬ 
jcctivo  ratings  compared  at  frequent  intervals.  Tliis  typo  of  grading 
system  is  similar  to  tho  one  developed  and  used  extensively  by  tho 
Royal  Canadian  Air  Force. 

Tho  reliabilities  and  validities  obtained  fall  in  about  tho  same 
rango  os  thoso  of  tho  objective  measures  tested  under  similar  experi¬ 
mental  conditions  at  tho  Primary  level,  described  in  chapter  0.  Tho 
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reliability  of  any  one  administration  of  a  check  ride  of  this  typo  is 
bo  low  that  the  results  of  a  considerable  number  of  independent  obser¬ 
vations  must  be  combined  to  discriminate  any  but  the  most  extreme 
eases. 

STUDY  2:  COMPARISON  OF  OBJECTIVE  AND  SUBJECTIVE 
MEASURES  TAKEN  DURING  THE  SAME  CHECK  RIDE 

A  check-ride  booklet  was  constructed  to  test  most  of  the  basic 
maneuvers  given  in  the  Central  Instructors  School  two-engine  cur¬ 
riculum.  This  new  check  ride  contained  several  subjective  measures 
covering  those  important  aspects  of  maneuvers  which  were  not  readily 
adapted  to  objective  measurement.  As  a  partial  control  for  the 
large  day-to-day  variability  in  conditions  and  performance,  this 
experiment  was  designed  to  give  two  check  rides  to  each  student 
within  the  same  half-day.  The  primary  purpose  of  this  study,  then, 
was  to  determine  the  test-retest  reliability  of  objective  and  subjective 
measures  when  each  student  was  tested  twice  within  the  same  half-day 
by  two  different  check  pilots. 

Procedure 

On  15  and  16  August  1944,  103  student-instructors  in  the  two- 
engine  group  were  given  the  check  rido  by  two  different  staff  in¬ 
structors.  The  students  flew  in  their  regular  training  planes,  49  in 
AT-’O's  (a  two-place  plywood  and  plastic  two-engine  trainer  made 
by  Becchcrnft)  and  54  in  the  UC-78  (Cessna  Bobcat,  a  standard 
advanced  two-engine  trainer  and  utility  cargo  plane  with  fabric  wings 
and  fuselage).  Two  auxiliary  fields,  were  used  exclusively  for  this 
experiment  thus  avoiding  the  heavy  traffic  normally  found  at  Ran¬ 
dolph  Field.  Unfortunately  the  wind  wfas  fairly  strong  and  gusty  on 
both  days  of  testing  with  turbulence  from  modcrato  to  severe.  All 
students  and  the  check  pilots  were  given  a  copy  of  the  scale  and  were 
thoroughly  briefed  before  making  tho  flights. 

The  Scale 

Of  the  38  separate  measures,  20  arc  objective  and  18  subjectivo 
work  samples.  The  slow  flying  maneuver  is  reproduced  to  illustrato 
the  for  i  of  instructions  and  the  measures.  Items  1,  2,  and  3  aro 
strictly  objective;  4  and  5  aro  subjective  work-sample  measures. 

Slow  Flyino 

“At  4,000  Feet,  With  a  Heading  of  90°,  Begin  Slow  Flying  at  45 
M.  P.  II.  (UC-78)  or  50  M.  P.  II.  (AT-10).  Maintain  This  Altitude 
and  Heading.” 

To  the  rater. — Mako  observations  during  a  3-minute  period,  begin¬ 
ning  with  moment  student  reduces  throttles.  At  tho  end  of  this  time, 
cut  tho  right  mixturo  control. 
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1.  Altitude  deviations:  Lowest . ft. 

Highest . ft. 

2.  Directional  control:  Starting  heading . ° 

Heading  of  maximum  deviation . ° 

3.  Air-speed  control:  Lowest . . . m.  p.  h. 

Highest . m.  p.  h. 

4.  Use  of  throttles  to  check  approaching  stall: 

. excellent  . poor 

. good  . never  approached  a  stall 

. fair 

5.  Attitude  of  plane  during  maneuver: 

. . nose  too  high  . . ...fluctuated  between  too 

. three-point  high  and  not  high 

. nose  not  high  enough 

enough 

A  listing  of  all  the  maneuvers  and  the  measures  used  is  given  in 
table  7.2. 


Table  7.2 — Test-reteal  reliability  of  objective  and  subjective  measures  of  two-engins 

J lying  skill 

Correlations 


Item  Description:  N-103 


Taiiino: 

1.  Uso  of  throttles . i . 

2.  Use  of  brakes . 

Normal  TAXt-orr: 

3.  Use  of  throttles  on  roll . 

4.  I.evel-ot!  between  10  nnd  23  ft . 

3.  During  level-oil  (Attitude) . 

0.  Ilrduetlon  of  power . 

7.  Climbing  air  speed . . . 

8.  Flight  path . 

0.  Cleared  are* . 

Slow  Flyino: 

10.  Altitude . 

It.  Direction . 

12.  A/3 . 

13.  Use  of  throttles . 

14.  Attitude. . 

Sinole-Kncini  Proceiure  From  Slow-Flvimo: 

15.  Directional  control  speed . 

IS.  A/3  . 

IT.  Heading . 

It.  Altitude . 

19.  Procedure  check-list . 

Stive  Turn: 

20.  Atlitude . 

21.  Rank  constancy  . 

22.  Hank  maximum  deviation . 

23.  Position  of  ball . 

Pattern: 

2.V  AlUtude}^  ,urn  ,0  Hi . 

2«S.  Altitude  during  ha.v.  leg . 

27.  Horn  (or  light)  check . 

St.  tleurchc.ks . 

Landino  (Power  Off): 

2?.  Altitude  at  ap|>ronch  turn . 

an.  A/.3  at  turn . . . 

31.  A/S  on  glide . 

32.  (tear chock.  . . . 

.33.  Itniindout  . . . 

31.  I.andlnr  attitude . 

33.  Point  of  landing  . 

?J.  Diri-elional  control  on  roll . 

Oter-ail  Hatinos: 

37.  Solf-cuntldi-nec  and  aggrculvrnrst . 

38,  Oenersl  pilot  ability... . 


Objective  Subjective 
measures  measures 


0.44tel 

”»iet 


a  i«o 

.240 


.130 
.  I4te| 
.410 
.280 


.<0tet 


33tet 

y.tet 

lOtet 


rtet 

4Mel 

32tet 


20trt 

2UC 

3ltet 

Kiel 


04  let 
U’tct 
2Stet 


2ltet 

Wet 

07trt 

33tet 


40C 


.84  let 


.  IStet 
.180 


*>»' 


220 
•  •  • 

240 


330 

420 


tot- tetrccborlc  correlation;  C-coc(Tlc!«ot  ol  contingency. 
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Results 

When  all  the  scores  were  distributed,  it  was  found  that  the  range 
was  unexpectedly  small  and  that  the  objective  deviations  were  usually 
recorded  in  even-numbered  units  (nearest  5°  heading,  5  m.  p.  h.,  etc.). 
Each  measure  of  heading,  air  speed  and  altitude  was,  therefore,  scored 
in  a  simple  dichotomy  with  the  “solit”  as  near  the  50  percent  point  as 
possible.  The  results  from  students  using  the  AT-10  and  UC-78 
were  combined  since  the  distributions  and  means  were  approximately 
equal  and  the  50-50  split  normalized  tho  distributions  of  the  heading, 
air  speed  and  altitude  measures.  Tctrachoric  correlations  and  co¬ 
efficients  of  contingency  43  were  used  to  determine  an  cstimato  of  test- 
retest  reliability.  Table  7.2  presents  theso  coefficients  for  all  items. 

Inspection  of  tablo  7.2  shows  that  the  objective  and  tho  subjective 
items  had  approximately  tho  same  reliabilities.  Tho  comparison  is 
complicated  by  tho  fact  that  tho  performance  measured  by  each  type 
of  item  may  not  be  equal  in  difficulty,  case  of  measurement,  and  con¬ 
sistency  from  day  to  day.  Not  enough  is  known  of  tho  inherent 
variability  of  the  specific  skills  measured  by  'die  objective  and  tho 
subjective  items  to  make  a  detailed  analysis  of  these  results.  How¬ 
ever,  this  check  ride  provided  enough  measures  of  both  types  to  show 
that  the  objective  measures  arc  as  reliable  as  the  subjective  measures 
when  obtained  under  tho  experiments’  conditions  of  this  study.  Had 
tho  study  involved  students  from  a  :  nber  of  different  schools,  how¬ 
ever,  one  would  expect  tho  reliability  of  tho  subjcctivo  measures  to  be 
further  lowered  by  differences  in  tho  standards  of  the  different  schools; 
the  reliability  of  tho  objective  measures  should  not  bo  reduced  since 
they  arc  mado  in  terms  of  measurements  which  are  relatively  inde¬ 
pendent  of  tho  observer. 

Validity 

Sinco  these  check  rides  wero  given  near  tho  end  of  training,  failing 
students  had  already  been  eliminated.  So  many  of  tho  passing  stu¬ 
dents  were  given  the  snmo  grade,  C,  that  it  was  impossible  to  compute 
reliable  correlations  with  final  g-ades. 

Summary  Comments 

This  study  demonstrated  several  principles  to  guide  further  research 
on  objective  measurement  of  flying  skill. 

1.  The  form  of  the  items:  Tho  form  of  tho  items  in  objective  check 
rides  should  allow  the  observer  to  maintain  a  running  account  of  tho 
successive  increases  in  instrument  deviations.  For  example,  if  the 
student  loses  100  feet  whilo  making  a  steep  turn,  returns  to  his  starting 
altitude  and  then  follows  with  a  second  deviation  of  150  foot,  tho  con¬ 
struction  of  tho  item  should  bo  such  os  to  permit  tho  check  pilot  to 
record  each  deviation  as  it  occurs  rather  than  waiting  until  tho  end 


*  I.  P.  (lullfofii,  Pit<komrtrk  Meikodi,  p,  357,  McOriw-IIlU  Book  Co.  Inc.  New  York,  N.  Y.  1930, 


of  the  maneuver  to  record  what  he  remembers  to  bo  the  largest  single 
deviation.  In  the  present  booklet  the  check  pilot  had  to  “write-in” 
the  maximum  instrument  deviations.  As  a  result,  most  readings  were 
made  to  the  nearest  even  number  (5°,  5  m.  p.  h.,  50  ft.,  etc.).  This 
results  in  some  loss  of  discriminating  power  of  the  measures. 

2.  The  population  to  be  tested:  As  far  as  possiblo  tho  objective 
measures  should  be  tested  with  a  normal  sample  of  cadets  in  training. 

If  tho  population  has  been  specially  selected  on  tho  basis  of  superior 
aptitude  or  special  training,  the  total  range  of  scores  will  bo  restricted 
making  it  more  difficult  to  obtain  ndequato  estimates  of  reliability 
and  validity.  Two  conditions  were  present  in  this  investigation 
which  increased  the  homogeneity  of  tho  students:  (a)  They  were  a 
select  group  of  abovc-nverago  pilots  sinco  most  student  officers  sent 
to  Central  Instructors  School  were  selected  from  the  upper  half  of 
their  Advanced  school  class  and  tho  poorer  members  of  this  selected 
group  had  been  eliminated  during  tho  first  phases  of  training  at  , 
Central  Instructors  School.  (6)  The  students  had  extensive  prior 
training  on  the  maneuvers  being  tested  sinco  Central  Instructors 
School  training  is,  for  the  most  part,  an  extension  of  Advanced  school 
training.  All  of  tlioso  pilots  had  a  good  deal  of  previous  practice 
performing  the  maneuvers  in  this  check  ride. 

3.  Standard  testing  conditions:  About  the  only  way  tho  interfering 
effects  of  weather  can  bo  controlled  is  to  schedule  tho  testing  at 
periods  when  it  is  expected  that  turbulence,  wind,  visibility,  nir 
density,  temperature,  etc.,  will  remain  somewhat  constant  and  at 
near  average  levels.  Objective  instrument  readings  cannot  adjust 
for  error  factors  produced  by  gusty  wind,  turbulence,  low  visibility, 
or  such  nonweather  conditions  ns  plane  differences  and  traffic.  Sinco 
tho  check  pilot  can  mako  necessary  compensations  when  making  a 
subjective  evaluation  of  tho  students'  performnneo,  it  is  apparent 
that  theso  nonpilot  factors,  operating  in  a  random  manner,  tend  to 
rcduco  the  reliability  of  the  objective  measures  more  than  that  of  tho 
subjective  ratings. 

Conclusion 

The  results  of  this  experiment  do  not  show  any  consistent  or  marked 
differences  in  tho  reliability  of  the  objective  and  subjective  measures. 
Tho  subjcctivo  items  referred  to  performance  considered  highly  im¬ 
portant  in  each  maneuver  and  for  which  tho  check  pilots  at  tho 
Instructors  School  had  been  frequently  “standardized”  os  to  tho 
correct  manner  of  teaching  and  grading.  Even  though  tho  subjectivo 
measures  might  givo  as  good  a  prediction  of  final  pilot  flying  ability, 
two  basic  limitations  of  that  approach  favor  tho  nioro  objcctivo 
measures:  (1)  Objective  measures  are  more  easily  standardized  from 
6chool  to  school  and  over  successive  periods  of  time;  (2)  it  is  easier  to 
interpret  tho  meaning  of  objcctivo  measures.  Tho  relatively  low 
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reliabilities  reported  in  studies  1  and  2  arc  probably  duo  to  variable 
pilot  performance  from  day  to  day  as  well  as  tho  change  in  testing 
conditions  (weather,  planes,  etc.). 

The  Revised  Check  Ride 

On  the  basis  of  the  information  obtained  in  tho  preceding  two 
studies,  a  moro  comprehensive  objective  scale  was  constructed  to 
include  additional  important  maneuvers  such  as  formation  flying  and 
stalls. 

The  first  draft  of  this  scale  was  constructed  in  cooperation  with 
Standardization  Board  members  at  tho  Central  Instructors  School 
and  at  Tampa  Army  Air  Field.  Eighty-eight  items  covering  12 
maneuvers  were  originally  constructed  and  then  criticized  and  modi¬ 
fied  by  these  expert  pilots.  After  flight  testing  tho  measures  with  5 
students  and  receiving  further  criticisms  from  experts,  a  final  form  was 
drawn  up  of  75  measures  covering  11  maneuvers.  Tablos  A7.1  and 
A7.2  in  tho  appendix  givo  an  inventory  of  the  maneuvers,  the  variables 
measured,  and  ono  complete  sample  maneuver.  It  will  bo  noticed 
that  a  good  deal  of  emphasis  is  given  to  formation  flying  since  this  is 
a  phase  of  contact  flying  which  is  highly  important  in  tactical  oper¬ 
ations. 

Duo  to  the  higher  priority  of  research  in  tho  instrument  area,  no 
statistical  data  were  obtained  on  this  scalo  before  tho  end  of  tho  war. 
It  is  believed,  however,  that  this  revised  scalo  may  servo  as  a  helpful 
starting  point  for  future  research  work  in  tho  contact  phase  of  multi- 
engino  flying  skill. 

Additional  objective  measures  of  two-engine  contact  flying  skill 
will  bo  found  in  tho  chcck-rido  booklet  which  is  reproduced  in  tho 
appendix  to  chapter  10. 

STUDY  3:  INTERCORRELATIONS  BETWEEN  19  OBJECTIVE 
MEASURES  OF  TWO-ENGINE  FLYING  SKILL 

Problem 

Intercorrelations  were  secured  in  an  attempt  to  obtain  information 
on  tho  various  factors  involved  in  flying  skill  and  tho  ways  items  should 
bo  combined  to  measure  them. 

Procedure 

The  intercorrelations  of  19  objective  measures,  plus  tho  pilot  stanino, 
wero  obtained.  Theso  19  measures  mado  up  a  check  rido  designed  to 
snmplo  differences  between  largo  groups  of  students  who  had  received 
different  amounts  of  training  at  Advanced  two-engine  schools  during 
tho  temporary  training  freezes.  A  copy  of  tho  chcck-rido  booklet 
containing  tho3o  measures  is  included  in  tho  appendix  to  chapter  10 
which  summarizes  the  differences  found  between  tho  groups.  The 
present  section  will  deal  with  only  tho  intercorrelations  of  these 
measures. 
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A  total  of  725  students  in  class  44-J  at  five  two-engine  schools  was 
used  in  this  study.  They  were  just  completing  their  10  weoks  of 
Advanced  training  in  the  TB-25  when  given  the  objective  check  ride. 

Results 

Intercorrelations  are  presented  in  appendix  tables  A7.3  and  A7.4. 
Inspection  of  these  tables  shows  consistently  low  intcrcorrclations. 
With  725  cases,  any  coefficient  with  a  valuo  of  ±.10  or  more  is 
significant  at  the  1  percent  lovel  of  confidence.  There  are  only  25 
(13  percent)  intercorrelations  significant  at  this  level  of  confidence. 
Some  of  these  intercorrelations,  such  as  the  ones  between  air  speed 
and  altitude  within  the  same  maneuver,  are  higher  because  the 
measures  are  tied  together  aerodynamically;  i.  e.f  when  a  plane  loses 
altitude  it  usually  picks  up  air  speed.  The  pilot  stanino  has  practically 
no  correlation  with  any  of  tho  items. 

Two  reasons  can  account  for  theso  results:  (1)  specificity  of  tho  skills 
being  measured  by  the  individual  items,  and  (2)  the  low  reliability  of 
tho  items.  From  tho  low  test-rctcst  reliabilities  secured  in  other  studies 
it  seems  likely  that  this  second  factor  was  of  greater  importance  in 
producing  tho  low  intcrcorrclations. 

Effect  of  Heterogeneity  of  Items  on  Reliability  of  Total  Scores 

To  tho  extent  that  theso  low  intcrcorrclations  aro  characteristic  of 
objective  measures  and  indicate  heterogeneity  of  tho  skills  measured, 
tho  amount  of  reliability  gained  from  combing  scores  in  different 
maneuvers  will  bo  less  than  that  which  would  bo  predicted  by  the 
Spearman-Brown  formula.  In  such  cases  tho  following  more  general 
formula  should  bo  used  for  predicting  tho  reliability  of  tho  combine* 
tion  of  standard  scores  on  different  items: 


_  r**» 

r“*M<*,+*'>-27uTW+^o 

in  which:  r(4+M(B»+#«)=tho  test-retest  reliability  of  tho  combined 

score  of  items  a  and  b. 
rM.= test-retest  reliability  of  item  a. 
rbb>  =  test-retest  reliability  of  item  b. 
r« »»,  r4.»,  etc.  =  tho  intcrcorrclations  of  scores  a,  b,  o',  6',  . 
etc.44 


From  an  examination  of  this  formula,  it  is  apparent  that  when 
tho  intcrcorrclations  of  tho  items  being  combined  equal  their  relia¬ 
bilities  (r44=r4»,  etc.),  this  formula  reduces  to  tho  Spearman-Brown 
and,  of  courso,  predicts  exactly  tho  samo  gain.  As  tho  intercorrelo- 
tions  approach  zero  there  is  less  gain  from  combining  tho  items. 
When  they  ore  zero  tho  reliability  of  the  combined  score  is  tho  average 
of  that  of  tho  items.  WHicn  tho  intcrcorrelations  aro  negativo,  com¬ 
bination  of  items  results  in  a  los3  of  reliability. 


»  Jackson,  Robert  W.  B.,  and  F  crimson,  O.  A.  Stud  It  i  on  Ikt  RelMUtti  of  Tiiti.  Toronto,  Drj'Vtment  of 
Educational  Research,  University  of  Toronto,  p.  M. 
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The  low  intcrcorrclations  reported  in  this  section  lead  one  to  suspect 
that  the  factors  measured  may  bo  heterogeneous,  so  that  the  gain 
from  combining  items  will  bo  less  than  that  predicted  by  the  Spear¬ 
man-Brown  formula.  The  average  test  retest  reliability  of  the  14 
maneuvers  in  study  1  in  this  chapter  was  0.14  (computed  by  Fisher's 
z-transformation);  the  reliability  of  tho  sum  of  theso  14  measures  was 
only  0.25.  From  tho  Spearman-Brown  formula  one  would  expect 
the  reliability  of  the  total  score  based  on  these  14  measures  to  be  far 
greater  than  0.25.  This  seems  to  indicate  that  tho  factors  being 
combined  actually  were  heterogeneous  so  that  the  assumptions  of 
the  special  case  covered  by  the  Spearman-Brown  formula  do  not  hold. 
If  such  specificity  should  be  characteristic  of  all  measures  of  flying 
skill,  it  would  incrcaso  the  difficulty  of  securing  a  reliable  total  score. 

STUDY  4:  AGREEMENT  BETWEEN  OBSERVERS  AS  A  TEST 

OF  OBJECTIVITY  41 


Problem 

Tho  low  reliabilities  obtained  so  far  with  objective  measures  of 
flying  skill  may  have  been  produced  by  either:  (1)  Variable  day-to-day 
performance  or,  (2)  errors  in  measuring  that  performance.  Evidence 
already  reported  in  chapter  6  on  Objective  Measures  of  Flying  Skill 
for  tho  Primary  Level  of  Pilot  Training,  indicates  that  tho  first  of 
theso  was  the  greater  source  of  unreliability  for  tho  measures  tested. 
This  experiment  was  designed  to  supply  further  cvidcnco  on  the 
sources  of  unreliability  by  investigating  tho  observer  reliability  of 
objective  measures  at  the  Advanced  two-engino  level  of  training. 
The  observer  reliability  was  determined  by  correlating  the  scores 
assigned  by  two  independent  observers  who  measured  tho  same  per¬ 
formance  at  tho  same  time. 

Procedure 

The  study  was  done  between  13-20  November  1944  with  class  44-1, 
flying  the  TB-25  at  Brooks  Field,  Tex.  The  measures  were  the  same 
19  referred  to  in  the  preceding  section  as  being  designed  to  sample 
differences  between  largo  groups  of  students  with  different  amounts  of 
training  received  during  a  temporary  training  freeze.  A  copy  of  tho 
check-ride  booklet  is  given  in  tho  appendix  to  chapter  10.  Nino  on- 
listed  men  from  tho  Pilot  Project  flew  ns  second  observers  to  score 
tho  maneuvers  simultaneously  with,  but  independently  of,  tho  check 
pilot.  .  These  nine  men  all  received  prior  training  and  practice  in 
scoring  these  measures  at  Randolph  Field.  The  correlation  between 
tho  independently  derived  scores  of  tho  two  observers  was  calculated 
for  each  item  of  each  maneuver  and  for  tho  total  scoro  for  each  ma¬ 
neuver.  Due  to  adverse  weather  conditions,  the  number  of  eases 


•*  Lt  John  R.  IlrtnphlU  and  T/Sjt.  William  0.  Matheny  were  chlfflj  rttporulbl*  for  this  axptrlmanl. 
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available  on  which  all  maneuvers  were  administered  to  the  same  stu¬ 
dent  was  so  small  that  it  was  not  worth  whilo  to  calculate  the  total 
score  for  the  completed  check  ride. 

Results 

In  general,  the  correlations  expressing  the  agreement  between  the 
two  independent  observers  were  satisfactorily  high.  Since  tho  obser¬ 
vations  of  a  number  of  randomly  paired  observers  arc  involved  in 
these  correlations,  they  indicate  absolute  as  well  as  relativo  agreement. 
The  number  of  cases,  tho  means  and  sigmas  for  each  set  of  observers, 
and  the  correlation  coefficients  expressing  tho  agreement  between  tho 
observers  are  given  separately  for  each  mensuro  in  table  7.3. 

Two  series  of  correlations  arc  given:  (1)  Tho  unconnected  Pcarsonian 
coefficients  for  items  scored  in  three  categories  and  phi  coefficients 
expressing  the  correlation  in  a  fourfold  point  surfaco  for  thoso  scored 
in  only  two  categories,  and  (2)  tho  Pcarsonian  coefficients  corrected 
for  tho  effects  of  grouping  the  data  into  tho  threo  broad  categories 
used  in  scoring  this  scale.  Tho  uncorrectcd  correlations  aro  tho  best 
estimate  of  the  reliability  of  a  scalo  scored  in  these  broad  categories. 
Tho  corrected  coefficients  arc  tho  best  estimate  of  tho  reliability 
which  would  be  obtained  by  scoring  the  scalo  in  finer  categories,  i.  o., 
by  feet  of  altitude,  miles  per  hour,  etc.  The  corrected  correlations 
must  be  used  in  comparing  the  observer  reliabilities  obtained  in  this 
study  with  those  of  other  studies  in  which  tho  measures  wero  scored 
in  finer  deviation  intervals.  One  of  these  other  studies  is  tho  compari¬ 
son  of  three  methods  of  scoring  basic  instrument  measures,  which  is 
reported  in  tho  next  chapter. 

Observations  of  tho  same  instruments  occurred  in  different  ma¬ 
neuvers,  c.  g.,  altimeter  readings  in  single-engine  procedure,  straight 
and  lovel  flight,  etc.  In  some  cases  tho  reliabilities  of  theso  similar 
observations  were  different  in  different  maneuvers.  An  examination 
of  tho  conditions  under  which  theso  observations  were  made  suggests 
certain  factors  which  may  be  related  to  the  objectivity,  or  scoring  • 
reliability,  of  observations. 

Air  speed,  deviation  was  scored  on  three  maneuvers:  Singlc-cngino 
procedure  (item  IC),  singlo-cngino  landing  (item  O),  and  instrument 
straight  and  level  flight  (item  U).  Tho  reliabilties  of  this  same  meas¬ 
ure  in  tho  threo  different  maneuvers  were  0.70,  0.25,  and  0.69,  respec¬ 
tively.  During  tho  singlc-engino  landing  mnneuver  there  was  a 
smaller  range  of  differences  in  air  speed  so  that  it  had  to  bo  measured 
in  smaller  units  (5  instead  of  10  m.  p.  h.)  which  were  more  difficult  to 
observe.  Furthermore,  since  part  of  this  maneuver  was  dono  while 
approaching  the  ground,  there  was  greater  stress  on  the  check  pilot  oa 
a  safety  observer.  Theso  two  conditions  probably  account  for  the 
lower  reliability  (0.25)  of  the  air  speed  reading  in  this  maneuver. 
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Tablf.  7.3. — Agreement  between  observers  on  the  Advanced  t-engine  scale 


Check  pDnt 

EM  observed 

N 

Til 

•'u* 

Mean 

SD 

Mean 

SD 

Sinoli-Ekcins  Procidcr*: 

J.  Heading:  (Maximum  deviation) . 

2.23 

0.70 

lit 

0.73 

83 

a  83 

0.84 

X.  A  r  «pccd:  (Minimum  A/S). ......... 

1.75 

.83 

1.68 

.  M 

65 

.70 

.05 

I.  AlUludo:  (Maximum  lost). . 

114 

.88 

117 

.80 

84 

.80 

1.00 

M.  Pr<rfr*lure  check  list . 

132 

.03 

148 

.88 

63 

♦  .61 

*61 

Total  score..  . 

8.63 

1.03 

144 

1.03 

84 

.70 

.84 

SlMRLK  1  M  INK  I.ANWNO: 

N.  Turn  onto  approach  lined  up  with 

1 

rtimt  \y . . . 

148 

.80 

113 

.00 

80 

♦  83 

*83 

O.  A/8  on  npproach:  (Maximum  devla- 

t  Ions  from  140).  .  . 

1.73 

.68 

1.84 

.07 

80 

.23 

.34 

P.  Waj  gear  checked  after  lowering  on 

approach? . 

114 

.09 

121 

.08 

68 

♦•63 

*65 

Q.  Where  wax  power  cut  completely? 

(Check  nearest  answer) . . 

R.  Where  was  landing  first  made?  (Ooal 

118 

.08 

1.06 

.08 

67 

.30 

1 

.80 

Is  xonc  Z) . 

1.88 

.73 

1.70 

.77 

47 

.81 

LOO 

8.  Landed  In  skid . 

164 

.84 

140 

.87 

30 

♦•31 

*61 

1107 

143 

1142 

148 

33 

.76 

.70 

Straight  and  Lkvkl  Plight:  (Inst.) 

T.  Heading  deviations . 

110 

.70 

102 

.87 

41 

.80 

.81 

U.  AIS  variations . 

141 

.70 

2  37 

.83 

41 

.60 

.03 

V.  A  It  Itudo  variations . . 

2  27 

.63 

120 

.80 

41 

.73 

.07 

5.78 

1.G7 

6.60 

108 

41 

.81 

.11 

Instruh  knt  Letdown  and  Low  ArntoAcn: 
W.  ra>itloit— I'hno's  track  In  relation  io 

ground  markers . 

1.68 

nj 

1.67 

.83 

24 

.03 

LOO 

X.  Time— Ulflircnco  between  prcscrtL"d 
tlmo  and  student's  elapsed  lima 

cast  low  oone . 

Y.  Altitude— Number  of  feet  difference 
between  prescribed  altitude  and 
student's  Indicated  altitude . 

103 

■o 

1.03 

.03 

?2 

.05 

LOO 

1.88 

.88 

1.81 

.83 

24 

.41 

.87 

Total . 

Powm-orr  Armosni  and  Landino: 

6.68 

100 

147 

121 

10 

•  V0 

.98 

Z.  A  It  Itudo  at  roll  onto  approach  varied 
nbovo  or  below  the  alt itude  (. .  ft.) 

102 

.34 

■  !] 

.44 

48 

.48 

.83 

A  A.  Was  power  Added  on  tho  Apnrach?.. 
lilt.  Where  was  landing  Unit  made . 

121 

.OS 

Bill 

.00 

48 

♦.08 

107 

.70 

.70 

43 

.80 

1.00 

7.  24 

1.11 

Ku 

1.23 

a 

.80 

.00 

rPhl  coefficients. 

Corrected  fur  broad  cntettorles,  tee:  Peterr,  Charles  0.  and  Van  Vporhls,  Walter  R.p  Stailtiical 
and  Thtir  Mallumaiieat  Haiti,  pp.  303-309. 


Altitude  deviations  were  scored  on  four  maneuvers:  Single-engine 
procedure  (L);  straight  and  lovcl  flight  (V);  instrument  let-down  and 
low  approach  (Y);  and  power-off  approach  and  landing  (Z).  The 
reliability  coefficients  were  0.80,  0.72,  0.42,  and  0.48,  respectively. 
Hero  again  the  coefficients  vary  with  tho  conditions  under  which  the 
observations  were  made.  In  the  instrument  let-down  and  low 
approach  (Y)  the  units  of  measurement  wero  only  in  20-foot  intervals 
and  tho  check  pilot  was  busy  scoring  other  aspects  of  tno  maneuver 
and  acting  as  safoty  observer  in  tho  heavy  traffic  conditions  usually 
present  when  flying  low  over  tho  field.  In  the  power-off  approach 
and  landing  (Z)  only  six  percent  of  tho  students  deviated  moro  than 
100  feet.  This  poor  distribution  probably  accounts  for  the  lower 
reliability. 

Heading  deviations  wero  scored  on  two  maneuvers:  Single-engine 
proccduro  (J),  and  instrument  straight  and  lovcl  flight  (T).  The 
reliabilities  of  tho  scoring  of  heading  deviation  on  tho  two  maneuvers 
wero  0.02  and  0.60,  respectively.  Tho  correlations  are  moderately 
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low  compared  with  those  obtained  on  other  measures.  Theso  lower 
observer  reliabilities  were  probably  produced  by  the  fact  that,  since 
the  students  held  their  heading  quite  well  during  theso  maneuvers,  it 
was  necessary  to  uso  a  small  scoring  interval  (5°),  which  represents  a 
relatively  slight  movement  of  tho  compass  and  henco  is  not  easy  to 
observe. 

Zone  of  landing  was  judged  on  two  maneuvers:  Single-engine  landing 
(R)  and  power-off  approach  and  landing  (BB).  Tho  reliability 
coefficients  wero  0.81  and  0.80,  respectively.  Observer  agreement  is 
high  for  both  maneuvers  indicating  little  difficulty  in  determining  the 
500-foot  zono  in  which  tho  plane  landed. 

Five  measures  of  a  somewhat  different  typo  wero  included  in  the 
scale.  Theso  measures  wero  scored  by  encircling  cither  1  or  3  on  the 
scoro  card;  tho  middlo  category  (2)  not  being  used.  Phi  coefficients 
wero  accordingly  used.  The  reliability  coefficients  ranged  from  0.51 
to  0.96  for  theso  five  measures. 

These  measures  included  observations  of  sequences  of  procedure 
and  also  judgments  such  as  whether  or  not  tho  plane  was  lined  up 
with  the  runway  or  whether  or  not  it  landed  in  a  skid.  Most  of  these 
wero  of  a  typo  which  requires  moro  training  and  experience  for 
accurato  observation  than  docs  tho  rending  of  instruments.  The 
enlisted  men  used  as  second  observers  had  a  minimum  of  timo  in 
which  to  acquaint  themselves  with  tho  sequences  of  procedure  and 
other  factors  involved  in  these  observations.  This  may  account  for 
tho  somewhat  lower  observer  reliability  of  this  typo  of  measure. 
Ono  of  these  measures,  “Was  power  added  on  tho  approach?”  was 
very  easy  to  observe,  and  tho  high  agreemort  between  tho  experienced 
check  rider  and  tho  less  experienced  enlisted  mon  is  reflected  in  a 
scoring  reliability  of  0.96. 

Summary 

Tho  reliability  of  scoring  of  several  objectivo  measures  of  flying 
skill  was  investigated.  Theso  observer  reliabilities  ore  in  general 
high,  but  readings  from  tho  samo  typo  instrument,  e.  g.,  altimeter, 
sometimes  has  a  different  reliability  when  used  in  different  maneuvers. 
An  analysis  of  theso  differences  in  tho  light  of  tho  experience  gained 
in  this  study  suggests  three  considerations  which  aro  important  in 
constructing  objectivo  measures  of  flying  skill: 

1.  The  conditions  under  which  tho  measuro  is  to  bo  scored  must  bo 
well  defined.  For  example,  the  beginning  and  end  of  tho  period 
during  which  the  students  arc  measured  should  bo  clearly  specified. 

2.  Tho  rnngo  of  variation  in  pcrformanco  of  the  student  should  bo 
such  that  small  errors  in  tho  actual  reading  of  tho  measuring  instru¬ 
ment  become  insignificant  in  comparison  to  tho  large  differences 
between  students. 

3.  The  amount  of  division  of  attention  demanded  of  tho  observer 
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should  bo  kept  as  low  as  possible,  especially  during  periods  of  stress 
when  tho  check  pilot  must  concentrate  on  tho  safety  of  the  airplane. 

Whcro  tho  measures  used  in  tho  Objective  Scale  of  Flying  Skill 
(Advanced  two-engino)  met  tho  conditions  specified  in  1,  2,  and  3, 
abovo,  scoring  reliability  was  high  enough  to  demonstrate  tho  possi¬ 
bility  of  creating  measures  of  Hying  skill  which  aro  satisfactorily 
objective.  * 

An  inference  from  theso  findings  is  that  tho  low  test  retest  relia¬ 
bilities  reported  clscwhcro  arc  probably  duo  to  tho  changing  test  con¬ 
ditions  and  variablo  pilot  performance  rather  than  to  errors  made  in 
scoring  and  recording  this  performance. 

SUMMARY 

Tho  importance  and  uso  of  two-  and  four-engino  aircraft  continued 
to  grow  during  tho  courso  of  tho  war  until  by  tho  end  approximately 
two-thirds  of  all  now  pilots  were  graduating-  from  Advanced  two- 
engino  schools.  Preliminary  experiments  were  conducted  in  this 
phaso  of  pilot  training  for  tho  purposo  of  finding  the  most  efficient 
area  for  concentrating  research.  After  these  studies  it  was  decided 
to  conccntrato  work  on  developing  and  testing  tho  objective  measures 
of  instrument  flying  skill  which  aro  described  in  tho  next  two  chapters. 
Four  studies  on  tho  measurement  of  two-engino  flying  skill  (contact) 
aro  reported  in  this  chapter. 

Study  1. — In  cooperation  with  tho  Two-Engino  Group  at  the  Cen¬ 
tral  Instructors  School,  Randolph  Field,  a  subjective  (rated  work 
samplo)  phaso  check  was  administered  to  69  student  instructors. 
Using  different  check  pilots  for  test  and  retest  on  different  days,  tho 
reliabilities  of  tho  individual  measures  ranged  from  0.00  to  0.26. 
Correlations  of  individual  measures  with  tho  instructor's  final  grade 
wero  in  tho  samo  low  range. 

Study  2. — In  this  experiment  both  objective  and  subjective  meas¬ 
ures  wero  included  in  a  chcck-rido  booklot  which  was  administered 
twico  to  the  samo  student  within  tho  samo  half-day  by  two  different 
check  pilots.  Tho  median  tcst-rctcst  reliability  coefficient  for  all 
tho  measures  was  0.27  with  tho  objective  and  tho  subjectivo  items 
showing  equal  reliabilities.  On  tho  basis  of  this  information,  a  more 
comprchcnsivo  objective  contact  check  ride  was  constructed  including 
objective  measures  of  formation  flying  skill.  Tho  end  of  the  war 
provented  tho  administration  and  statistical  analysis  of  this  revised 
scale. 

Study  3. — Tho  intcrcorrolations  botween  19  objective  measures, 
plu9  tho  pilot  stnnino,  wero  found  to  bo  extremoly  low.  This  was 
probably  duo  to  tho  unreliability  of  tho  separate  measures. 

Study  4‘ — Tho  porformanco  of  students  on  each  of  19  objective 
measures  was  scored  simultaneously  by  two  independent  observers. 
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Comparing  these  with  the  soven  less  accurately  scored  measures  sug¬ 
gested  principles  to  bo  followed  in  reducing  the  observer  error  in 
objective  measures. 

The  data  in  this  chapter,  like  the  results  in  tho  provious  one,  deal¬ 
ing  with  objective  measurement  at  tho  Primary  level,  indicato  that 
tho  low  tcst-rctcst  reliabilities  of  objective  measures  are  more  a  func¬ 
tion  of  changing  test  conditions  and  variable  pilot  performance  than 
of  errors  in  observing  and  scoring  this  performance. 


CHAPTER  EIGHT 


Objective  Measures  of  Multi- 
engine  Instrument  Flying  Skill 

Capt.  Stanford  C.  Erickscn 


INTRODUCTION 

Reasons  for  Concentrating  oo  this  Are* 

Instrument  Hying  refers  to  tho  control  of  the  piano  by  cues  from 
a  group  of  instruments  in  tho  cockpit  when  tho  normal  cues  from  out¬ 
side  tho  piano  aro  obscured  by  conditions  such  as  clouds  or  darkness. 
Skill  in  instrument  Hying  was  exceedingly  important  during  tho  war 
since  the  treme  ndous  mobility  of  the  nirplano  as  weapon  or  transport 
was  useless  whenever  it  had  to  bo  grounded  bccauso  of  bad  weather. 
Tho  engineering  developments  which  produced  planes  capablo  of 
flying  long  distances  through  difficult  weather,  created  a  demand  for 
pilot?  with  a  high  level  of  instrument  flying  skill. 

As  has  already  been  pointed  out,  tho  Pilot  Project  concentrated  a 
considerable  proportion  of  its  work  on  developing  objective  measures  of 
instrument  flying  skill.  The  importance  of  instrument  flying  was  ono 
reason  for  this  decision;  another  was  tho  fact  that  this  typo  of  flying 
seemed  to  bo  adapted  to  objcctivo  measurement  bccauso  it  waa 
conducted  solely  with  rcfcrcnco  to  instruments  and  radio  aids. 

Tho  main  work  on  developing  objcctivo  measures  of  flying  skill  was 
started  on  an  Advanced  two-engino  piano,  tho  TB-25.  This  was 
sblccted  for  a  number  of  reasons.  Ono  of  theso  reasons  was  bccauso 
any  improvement  in  measuring  proficiency  at  tho  Advanced  level 
would  bo  more  useful  in  selecting  pilots  for  special  combat  assign¬ 
ments  than  would  an  improvement  at  an  earlier  level.  From  two- 
thirds  to  three-fourths  of  the  Advanced  students  wero  trained  in 
two-engino  planes,  and  instruments  wero  especially  important  in 
flying  heavy,  long-range  aircraft  of  this  type,  Furthermore,  in  theso 
two-engino  planes  it  was  possible  for  tho  aviation  psychologist  to  rido 
as  an  additional  observer  along  with  tho  student  and  his  instructor. 

After  measures  for  two-engine  planes  at  tho  Advanced  level  had 
been  developed  and  evaluated,  tho  knowledge  and  experience  gained 
was  used  in  planning  work  on  singlc-engino  planes  at  tho  Basic  Iovol. 
This  is  described  in  tho  next  chapter. 

Main  Fcatuics  of  Instrument  Training 
Tho  complexities  of  instrument  flying  have  been  described  in 
chapter  3.  It  was  necessary  for  tho  pilot  to  keep  responding  to  a 
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half-dozen  different  instruments.  A  deviation  in  any  ono  of  a  num¬ 
ber  of  different  variables,  for  example,  altitude,  heading,  or  air  speed, 
meant  that  he  was  not  flying  correctly.  Furthermore,  it  was  import¬ 
ant  for  him  to  cross-check  and  interpret  tho  readings  from  sovoral 
different  instruments. 

Tho  difficulty  of  instrument  flying  made  it  necessary  to  givo  the 
students  extensivo  specialized  training.  Students  were  not  introduced 
to  instrument  training  until  after  Naming  the  fundamental  elements 
of  flying  by  reference  to  tho  ground  and  horizon,  i.  e.,  contact  flying. 
Instrument  training  started  at  the  basic  level.  The  student  was 
placed  under  a  cloth  hood  which  eliminated  outsido  cues  and  taught 
to  rely  solely  on  his  instruments  in  flying  tho  fundamental  maneuvers 
such  as  straight  and  lovcl,  climbs,  glides,  and  turns,  and  in  recovering 
from  unusual  positions.  Approximately  20  hours  were  devoted  to 
tliis  training  at  tho  Busic  level. 

At  tho  two-engino  Advanced  lovcl,  tho  student  received  20  more 
hours  of  instrument  flying.  Tho  first  few  hours  were  spent  in  relearn¬ 
ing  on  tho  moro  powerful  two-engine  plane  tho  fundamental  ma¬ 
neuvers  practiced  at  Basic.  The  transition  was  usually  fairly  rapid 
and  few  students  were  eliminated  because  of  failure  to  pass  tho  “Basio  • 
Instrument  Cheek”  covering  theso  maneuvers. 

Tho  remaining,  larger  portion  of  tho  time  was  spent  in  learning  to 
use  radio  aids  in  problems  such  as  navigation,  flying  on  tho  beam,  and 
making  the  instrument  let-down  and  low  approach  which  allowed  the 
pilot  to  como  down  through  an  obscuring  layer  of  clouds  and  break 
out  into  tho  clear  immediately  abovo  tho  field  in  a  position  to  land. 
This  part  of  tho  training  caused  tho  poorer  students  considerable 
difficulty,  since,  in  addition  to  holding  precise  limits  of  altitudo,  head¬ 
ing,  and  air  speed,  they  had  to  interpret  and  respond  correctly  to  a 
series  of  radio  signals  wlvich  wero  often  obscured  by  static  and  difficult 
to  distinguish. 

Studies  to  be  Described 

The  first  objectivo  measures  of  instrument  flying  skill  constructed 
by  tho  Pilot  Project  wero  part  of  a  largc-scnlo  study  of  tho  effects  of 
additional  training  on  flying  skill.  Tho  next  study  compared  the 
effectiveness  of  threo  different  methods  of  scoring  instrument  devia¬ 
tions.  In  tliis  study  tho  observer  reliability,  test-retest  reliability, 
and  correlation  with  instructor  ratings  wero  determined  for  represent¬ 
ative  measures. 

On  tho  basis  of  tho  experience  gained  in  this  work,  a  list  was  made 
of  tho  procedures  to  bo  followed  in  developing  objectivo  measures  of 
flying  skill,  and  a  34-item  check  rido  was  developed  for  tho  TB-25. 
Tho  measures  in  this  rido  were  administered  to  students  on  each  dual 
ride  in  order  to  determine  (a)  tho  reliability  of  each  measure  os  shown 
by  tho  correlation  between  tho  scores  on  odd  and  even  days  of  admin- 
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istration,  (6)  the  ability  of  selected  measures  to  discriminnto  between 
different  amounts  of  training,  and  (c)  tho  correlation  of  measures  with 
instructors*  ratings. 

In  order  to  get  preliminary  information  on  additional  measures  and 
to  secure  answers  to  certain  questions  which  interested  tho  adminis- 
trutivo  staff  at  tho  school  whero  tho  TB-25  studies  were  being  con* 
ducted  a  70-item  check  rido  was  constructed  and  administered  to 
all  students  on  the  last  day  of  their  regular  instrument  training  and 
again  just  beforo  they  graduated  four  weeks  later.  An  experimental 
group  of  students  who  had  been  receiving  tho  shorter  scalo  on  every 
dual  rido  was  compared  with  a  control  group  who  had  not  used  this 
scalo.  The  scores  of  students  at  the  end  of  tho  formal  period  of 
instrument  training  were  compared  with  thoso  four  weeks  later. 

On  tho  basis  of  this  work,  a  refined  scalo  for  tho  TB-25  was  con¬ 
structed.  The  temporary  disruption  of  training  produced  by  tho  end 
of  tho  war  prevented  experimental  evaluation  of  this  scale. 

Finally  somo  work  was  started  on  developing  and  giving  pre¬ 
liminary  try-outs  to  measures  of  four-engino  instrument  flying  skill 
and  an  exploration  was  mado  of  the  possibilities  of  securing  records 
by  attaching  a  work-adder  device  to  the  flight-control  cables. 

RESULTS  OF  TIIE  INSTRUMENT  MEASURES  USED  IN  A 

LARGE-SCALE  STUDY  OF  THE  EFFECTS  OF  ADDITIONAL 

TRAINING 

Tho  Pilot  Project  designed  a  number  of  measures  of  instrument 
flying  skill  to  determine  tho  effect  of  an  additional  5  weeks  of 
training  given  to  all  student  pilots  during  temporary  training  froezos. 
Tho  complete  study  is  presented  in  chapter  10.  Items  to  measure 
tho  accuracy  of  the  instrument  let-down  and  low  approach  (to 
landing)  wero  developed  sinco  most  instrument  training  was  directed 
toward  the  development  of  skill  on  this  final  maneuver. 

At  the  Advanced  two-engino  schools  data  wero  obtained  on  students 
with  three  different  amounts  of  training; 

Group  I:  10  weeks  in  lighter  two-on^ino  aircraft,  AT-10  and 
UC-78,  followed  by  5  weeks  in  tho  TB-25. 

Group  II;  10  weeks,  all  in  tho  TB-25. 

Group  III:  15  weeks,  all  in  tho  TB-25. 

The  extra  5  weeks  of  training  was  found  to  improvo  tho  skill  of  the 
students  in  group  III  who  had  all  15  weeks  in  tho  TB-25.  On  the 
other  hand,  the  students  in  group  I  who  also  had  15  weeks  of  Advanced 
training,  but  in  two  different  typo  aircraft,  were  inferior  to  group  III 
in  tho  accuracy  of  tho  instrument’  let-down  and  low  approach. 
In  fact,  they  were  also  inferior  to  the  students  with  only  10  wcoks  of 
Advanced  training,  all  in  tho  TB-25.  Pilots  havo  frequently  assumed 
a  high  degreo  of  positivo  transfer  of  instrument  flying  skill  from  one 
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typo  aircraft  to  another.  In  general,  this  is  probably  truo,  but  thes* 
results  indicato  the  importance  of  being  familiar  with  the  particular 
type  piano  being  flown  as  a  prerequisite  for  precision  instrument 
flying. 

Measures  wero  also  developed  at  the  Basic  and  Advanced  single- 
engine  lovcls  to  determine  the  way  in  which  tho  extra  five  weeks  of 
training  effected  both  contact  and  instrument  flyiug  skill.  The 
results,  presented  in  chapter  10,  show  that  in  general  moro  reliable 
differences  wero  secured  on  tho  instrument  than  on  the  contact 
measures.  Tliis  result  confirmed  tho  decision  to  concentrate  furthor 
work  on  tho  instrument  measures. 

COMPARISON  OF  THREE  DIFFERENT  METHODS  OF 
SCORING  INSTRUMENT  MEASURES  * 

Ono  of  tho  first  problems  systematically  studied  in  developing 
objective  measures  of  instrument  flying  skill  was  tho  question  of  how 
best  to  scoro  and  record  instrument  deviations  in  order  to  maximize 
tho  reliability  and  validity  of  theso  measures. 

Statement  of  the  Specific  Problem 

Tho  problem  was  to  determine  how  tho  following  tlirco  different 
methods  of  scoring  instrument  deviations  compared  with  respect  to: 
observer  reliability,  test-rctcst  reliability,  and  validity: 

1.  Tirru  sample  method. — Instrument  readings  of  a  student’s  por- 
formanco  wero  taken  at  specific,  equally-spaced  periods  during  the 
courso  of  a  maneuver.  For  example,  deviations  from  tho  starting 
altitudo  were  taken  every  20  seconds.  Tho  student’s  scoro  was  tho 
average  of  tho  deviations  on  all  the  readings  of  tho  appropriate  instru¬ 
ment  (altimeter,  compass,  or  air  speed  indicator). 

2.  Limits  method. — This  was  recording  tho  student’s  maximum 
singlo  deviation  from  the  specified  starting  point  on  tho  instrument 
being  observed,  o.  g.,  greatest  number  of  feet  lost  (or  gained)  in 
altitudo  at  any  timo  during  tho  maneuver. 

3.  Range  method. — In  this  caso  tho  score  represented  tho  student’s 
total  rongo  of  deviation  between  tho  two  extremes,  o.  g.,  difference 
between  greatest  deviation  to  the  left  and  to  tho  right  of  tho  initial 
heading,  or  difference  between  lowest  and  highest  altitudo  reached 
during  tho  wholo  mancuvor. 

In  nil  theso  methods  tho  observer  scored  tho  maneuver  by  making  a 
mark  at  tho  appropriate  placo  on  a  facsimilo  diagram  of  tho  instru¬ 
ment.  When  using  tho  timo  samplo  method,  a  sepnrato  scoring  sheet 
was  used  for  each  successive  reading.  Tho  rango  and  tho  limits 
scores  could  both  bo  obtained  from  tho  samo  scoro  sheet,  as  illustrated 
in  figuro  8.1.  Tho  check  pilots  were  instructed  to  mako  a  new  mark 

*  Set.  John  R.  Rohr*  nod  Sgt.  Msurlco  P.  Connery  tr«  chiefly  rospotuibls  for  thU  study. 
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each  timo  they  observed  a  deviation  in  either  direction  larger  than 
the  greatest  one  previously  recorded  in  that  direction.  In  tho  example 
in  figure  8.1,  tho  student’s  range  scoro  for  nltitudo  was  340  feet,  his 
limits  scoro  240  feet. 


Figure  S.l — Sample  tcore  sheet  used  for  the  range  and  limit  me IhodCof  measuring 
altitude  in  the  steep  turn.  ( Reduced  to  H  <>«  used.) 

Whiio  the  range  and  limits  readings  could  both  bo  obtained  from 
observations  of  tho  same  performance,  tho  maneuver  had  to  bo 
repeated  to  derive  tho  timo  samplo  score.  Tho  scqucnco  of  repeti- 
tion  was  counterbalanced  throughout  tho  study. 

The  Maneuvers  on  Which  the  Students  Were  Tested 

Straight  and  level  course  with  changing  air  speeds. — Tho  trial  started 
at  tho  student’s  signal  when  he  was  flying  straight  ami  level  at  0,000 
feet  on  a  heading  of  .300°  and  at  an  air  speed  of  200  m.  p.  h.  Tho 
total  maneuver  was  mado  up  of  four  separato  parts  but  throughout 
each  of  theso  parts,  tho  task  remained  tho  snmo:  to  maintain  tho 
original  heading  and  altitude.  Tho  four  parts  with  a  common  task 
were: 

a.  During  the  first  2M-minutc  period  the  student  reduced  air  speed 
from  200  m.  p.  h.  to  160  m.  p.  h. 

b.  lie  held  this  air  speed  for  #  minute. 

c.  During  the  next  2J»  minutes  air  speed  was  increased  back  to  200 
m.  p.  h. 

d.  For  the  last  K  minute,  tho  student  held  tins  air  speed.  Separato 
scores  were  obtained  for  each  of  these  four  legs. 

Two  steep  turns. — Starting  at  6,000  feet,  at  cruising  throttle,  tho 
student  made  a  45°  bank  turn  to  tho  left,  holding  this  bank  and  con¬ 
tinuing  tho  turn  for  one  minute.  Tho  maneuver  was  then  repeated 
to  the  right.  Tho  student  was  graded  on  altitudo  control  and  hold¬ 
ing  tho  45°  bank. 

Procedure 

Tho  experiment  was  conducted  at  tho  Advanced  two-engino  school 
at  Brooks  Field,  Tex.,  in  December  1044.  Tho  instructor  and  super¬ 
visory  personnel  selected  the  30  best  and  tho  30  least  proficient 
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instrument  students  from  class  44-J  currently  receiving  tho  extra 
5  weeks  of  TB-25  training  resulting  from  tho  second  training  freeze. 
Bccauso  tho  students  had  only  received  an  average  of  approximately 
5  hours  instrument  training  at  Brooks  Field,  tho  separation  of  these 
two  criterion  groups  was  probably  not  as  good  as  that  which  could 
bo  obtained  under  moro  favorablo  circumstances. 

Ten  enlisted  men  from  tho  Pilot  Project  received  preliminary 
training  and  then  served  as  the  second  observers  for  tho  ten  Brooke 
Field  check  pilots  assigned  to  tho  study.  Each  check  pilot  and 
Bccond-observcr  team  flew  with  a  total  of  six  students — three  from 
tho  most  and  three  from  the  least  proficient  group  of  students.  Equal 
numbers  of  good  and  poor  students  wero  flown  during  each  half  day. 

No  check  pilot  flew  with  his  own  students,  nor  did  he  know  from 
which  of  tho  two  extreme  gr  mps  they  came.  All  students  and  check 
pilots  were  carefully  briefed  prior  to  the  flights. 

Results 

Observer  reliability. — Tho  first  analysis  was  to  detormino  tho 
observer  reliability  of  tho  three  methods  by  comparing  tho  scores 
recorded  by  tho  check  pilot  with  thoso  recorded  by  tho  second  ob¬ 
server.  Tho  only  maneuver  on  which  observer  reliability  data  were 
availablo  was  tho  straight  and  lovcl  courso  with  changing  air  speed. 
During  tho  other  maneuver,  the  steep  turn,  the  check  pilot  functioned 
as  a  safety  observer  and  only  tho  second  observer  recorded  the 
deviations. 

Tho  data  on  observer  reliability  are  given  in  table  8.1.  When  • 
interpreting  theso  data  it  should  bo  recognized  that  tho  time  sample 
scoro  is  tho  mean  of  22  observations  while  tho  range  and  limits  score 
aro  based  on  tho  maximum  deviation  occurring  at  any  time  during 
tho  manouver. 

For  both  tho  heading  and  altitude  measures  tho  time  sample  score 
gavo  tho  highest  observer  reliability.  This  was  expected  since  this 
method  provided  rigid  control  as  to  just  when  and  what  deviations 
were  recorded.  Tho  observer  did  not  havo  to  try  to  keep  track  of 
all  of  tho  instruments  all  of  tho  time.  This  narrowing  down  of  the 
task  of  tho  observer  increased  tho  accuracy  of  observation.  It  was 
also  dcsirablo  to  dotermino  its  effect  on  tho  test-rotest  reliability  and 
tho  validity  of  tho  observations. 

Test-retest  reliability.— An  estimate  of  test-retest  reliability  (or 
*  perhaps  it  should  be  called  internal  consistency)  was  obtained  by 
correlating  tho  right  versus  the  loft  stcop  turn  and  tho  first  two  legs 
versus  second  two  legs  of  tho  straight  and  lovel  courso  with  changing 
air  speed.  Theso  data  aro  given  in  table  8.2  and  aro  already  adjusted 
for  doublo  length  by  tho  Spearman-Brown  correction. 

Sinco  theso  coefficients  wero  based  on  measurements  token  from  the 
some  trial,  variables  such  as  turbulenco,  student  day-to-day.  varia- 
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bility  and  piano  differences,  were  held  at  a  minimum.  In  this  senso 
these  are  maximum  estimates  of  tcst-rctcst  reliability. 


Table  8.1. — Correlation  between  the  ecortt  recorded  by  two  obtervert  during  lAi 
straight-and-level  course  with  changing  air  speed 

N-60 


Method  of  soorinx 

IT eadln( 
deviation 

Altitude 

deviation 

Time  sample:  Average  of  deviations  observed  at  12  specified  times... 

mmm 

air 

Hence:  Difference  between  extreme  deviations  In  each  direction . 

t 

Limit:  Ores  test  single  deviation  In  either  direction . 

.54 

.71 

Means  and  standard  deviations  er#  given  in  appendix  UbU  AS.I. 


Table  8.2. — The  test-retest  reliability  of  the  three  different  melhodt  of  t coring  bated 
on  teste  administered  in  immediate  succession  to  60  students 

N-60 


/ 

Straight  and  lavtl 

JklOlEKHl  Ql  lODniif 

Heading 

Altitude 

Time  sample _ _ _ _ _ _ 

an 

0.67 

H  fin  KG . . . . . . . 

.50 

.M 

.61 

Limits . . . 

■EJ 

.It 

Meanx  and  standard  deviations  an  given  In  appendix  table  AS. 2. 


It  will  bo  noted  that  tho  time  samplo  method  did  not  produce  con¬ 
sistently  higher  tcst-rctcst  reliabilities  than  tho  rango  or  limit* 
methods.  Though  limiting  tho  observations  to  certain  specified  times 
produced  a  higher  observer  reliability  than  continuous  observation, 
tho  fact  that  tho  behavior  between  observations  was  neglected  appar¬ 
ently  offset  this  advantago  so  that  tho  tcst-rctcst  reliability  was  no 
higher. 

Validity. — Which  of  these  three  methods  of  scoring  best  differen¬ 
tiates  the  two  criterion  groups?  Tnblo  8.3  gives  tho  validity  coeffi¬ 
cients  for  tho  three  measures  together  with  an  indication  of  their 
lovcl  of  significance. 


Table  8.3. — Point-biserial  correlations  between  the  measures  and  the  criterion 

N-60 


• 

Steep  turn 
altitude 

Straight  and  lev* 

Deeding 

Altitude 

Tim*  turn  pit...  _ _ t. _ ..............  . . . 

••0.36 

••*.31 

•*.33 

••♦d  30 
•••.31 
.15 

a  is 
••.a 

Umltfl  , _ _ _ _ _ _ _ 

Probability  of  obtaining  a  positive  correlation  ot  thlx  xlxa  by  ebanoa  alone: 
No  asterisk -more  thun  10  times  In  100. 

*-10  times  In  ino  or  Ires. 

*•-2.5  times  In  100  or  Ires. 

•**-0.5  times  In  100  or  Ires.  . 

Means  and  standard  deviations  are  (Ivan  In  appsodl;  labia  AOS. 
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Examination  of  tbia  table  shows  that  tho  range  method  of  scoring 
correlates  somewhat  higher  with  tho  criterion  than  do  tho  other 
methods. 

Tho  noxt  question  was  to  determine  the  significance  of  tho  differ¬ 
ences  between  tho  validities  obtained  from  tho  use  of  the  three 
methods.  Tablo  8.4  gives  the  probabilities  that  differences  as  large 
as  those  observed  would  bo  expected  to  occur  by  chance  alone.  Since 
tho  range  and  limits  scores  were  highly  correlated,  in  computing  the 
standard  error  of  tho  differences  between  these  correlations,  the 
intcreorrelation  of  tho  scores  upon  which  they  aro  based  was  taken 
into  account.  .  Tho  correction  formula  used  is  given  on  page  218  of 
Statistical  Analysis  in  Educational  Research  by  E.  F.  Lindquist,  1940, 
Houghton  Mifflin  Co.,  N.  Y. 


Table  8.4. — Probability  of  i retiring  by  chance  differences  between  the  three  methods 
of  scoring  at  large  as  those  observed  (see  table  8.8) 


Stern  turn 
altitude 

Straight  and  le  ret 

Heading  ! 

Altitude 

Range  versus  limits . 

•.fja 

a  oi 

aor 

Hence  versus  lira*  simple . . . 

.44 

.it 

l»lmlu  versus  time  sample . . . . . 

m 

.U 

.a 

From  tho  results  in  tables  8.3  and  8.4  it  can  bo  concluded  that  the 
rango  method  is  slightly  better  than  the  limits  method.  While  the 
tftno  samplo  method  has  higher  observer  reliability,  it  does  not  hove 
higher  validity  and,  in  addition,  is  moro  difficult  for  tho  check  pilot  to 
administer  in  flight  when  he  is  also  busy  acting  as  safety  observer, 
instructor,  and  copilot. 

Comparison  of  the  Total  of  Four  Part -Scores  Versus  a  Single  Maximum 
Deviation  Score 

Tho  rango  and  limits  scores  analyzed  up  to  this  point  were  bused 
on  tho  largest  deviation  occurring  during  any  part  of  tho  entiro  ma¬ 
neuver.  As  was  described  previously,  the  straight-and-lcvcl  course 
was  made  up  of  four  legs:  Reducing  air  speed,  holding  this  reduced  air 
speed,  increasing  air  speed,  and  maintaining  the  final  air  speed. 
Throughout  tho  maneuver,  tho  student’s  task  was  to  maintain  tho 
original  heading  and  altitudo.  On  each  of  the  four  legs  separate 
rango  and  limits  scores  wero  obtained.  A  total  score  was  then  com¬ 
puted  which  was  the  sum  of  the  maximum  deviations  occurring  dur¬ 
ing  each  of  the  four  legs.  This  total  score  approaches  tho  timo  sample 
technique  but  with  tho  decided  advantago  that  tho  observer  main¬ 
tained  constant  watch  and  obtained  a  record  of  tho  student’s  largest 
errors  rather  than  simply  recording  what  deviations  existed  at  speci¬ 
fied  timo  intervals. 
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The  same  statistical  analyses  wero  applied  to  the  total  scores  as  to 
tho  singlo  scores  described  in  tho  preceding  pages.  Tho  results  of 
these  two  types  of  scores  are  presented  in  table  A8.4  in  tho  appendix. 
It  can  bo  concluded  that  tho  two  types  of  scores  are  approximately 
equal.  Tho  differences  are  small,  inconsistent,  and  could  easily  have 
occurred  by  chance.  Under  tho  conditions  of  this  experiment,  a 
measure  of  a  student's  largest  singlo  deviation  during  a  maneuver 
seems  to  be  as  accurate  an  index  of  his  instrument  flying  ability  as  a 
series  of  four  readings  taken  from  tho  same  maneuver  and  added 
together. 

An  incidental  finding  was  that  tho  test-retest  reliability  of  tho 
altitude  measures  were  less  rcliablo  than  tho  heading  measures  in  tho 
straight-and-lcvcl  course  with  changing  air  speeds.  This  can  perhaps 
bo  understood  in  terms  of  the  opposite  effect  produced  by  decreasing 
power  during  tho  first  half  of  the  maneuver  while  adding  power  during 
the  second  half. 

Summary 

1.  Tho  validity  coefficients  obtained  for  the  separate  items  in  this 
study  arc  high  enough  to  bo  promising  for  singlo  items  to  bo  included 
as  ono  of  a  series  of  objective  measures  of  instrument  flying  skill. 
This  validity  was  established  despite  the  fact  that  the  criterion  groups 
were  selected  by  instructors  who  had  on  the  averngo  only  5  hours  of 
dual  timo  in  which  to  observe  their  students’  instrument-flying  ability. 

2.  Tho  range  method  gavo  slightly  higher  validity  coefficients  than 
tho  limits  method  although  there  was  no  difference  in  either  observer 
or  test-retest  reliability. 

3.  Tho  timo  sample  validities  wero  no  greater  than  those  of  tho 
rango  method. 

4.  The  timo  sample  method  had  higher  observer  reliability  than  tho 
other  two  methods.  Its  test-retest  reliabilities,  howover,  wero  about 
tho  samo  as  thoso  for  the  other  two  methods.  This  high  observer 
reliability  did  not,  in  this  case,  give  the  timo  sample  method  a  higher 
tcst-rctest  reliability  or  validity  than  the  range  method. 

5.  Thcro  were  no  consistent  differences  in  observer  reliability,  tcst- 
rctest  reliability,  or  validity  between  two  types  of  scoring,  ono  based 
on  tho  largest  single  deviation  during  tho  entiro  maneuver  and  tho 
other  a  total  of  tho  largest  deviation  during  four  parts  of  the  maneuver, 
Btraight-and-lovcl  courso  with  changing  air  speeds. 

PROCEDURE  TO  BE  FOLLOWED  IN  DEVELOPING  A  COM¬ 
PREHENSIVE  CHECK  RIDE  TO  MEASURE  INSTRUMENT. 

FLYING  SKILL 

Beforo  constructing  instrument  items  for  a  comprehensive  check 
ride  of  instrument-flying  skill,  a  general  outlino  of  procedures  was 
prepared,  based  on  the  accumulated  experience  of  tho  Pilot  Project 

189 


703322 — 47 - 14 


working  in  all  phases  of  objcctivc-scalo  construction  and  experimenta¬ 
tion.  Tko  optimum  sequence  in  the  development  of  objective 
measures  can  bo  summarized  as  follows: 

1.  Analysis  of  tho  fundamental  skills  essential  to  practical  success 
in  operational  instrument  flying  and  analysis  of  tho  curriculum  used  to 
teach  theso  skills. 

2.  Construction  of  tentative  items  with  the  aid  of  technical  experts. 

3.  Testing  the  items  with  a  few  students  in  order  to  determino 
practicability  and  to  refine  administrative  details,  scoring,  and 
scqucnco  of  maneuvers. 

4.  Administration  to  groups  largo  enough  to  allow  statistical  item 
analysis.  Tho  reliability  of  each  measure  is  obtained  by  two  or  more 
administrations  of  tho  test.  Tho  validity  of  each  measure  is  obtained 
by  any  one  or  a  combination  of  three  methods:  Testing  of  twoextromo 
groups  selected  on  the  basis  of  known  flying  skill;  testing  two  groups 
with  widely  different  numbers  of  hours  of  training;  testing  of  a  large 
enough  group  to  permit  correlations  between  instructors’  subjective 
ratings  of  flying  ability  and  objective  scores.  Intercorrclations  may 
also  be  obtained  at  this  stngo  to  eliminate  duplication  of  items  meas¬ 
uring  tho  samo  skills.  Normative  data  aro  secured  in  order  to  help 
in  setting  class  intervals  for  scoring  weights. 

5.  On  tho  basis  of  tho  statistical  data  provided  by  tho  preceding 
analysis,  tho  best  measures  aro  selected  and  refined.  Then  theso  ora 
tried  out  again  on  a  large  number  of  students  as  a  second  check  on  the 
results  nlrcndy  obtained.  This  final  testing  will  profit  from  the  ex¬ 
perience  gained  about  how  best  to  administer  objective  check  ridea 
within  tho  normal  student-training  schedule;  briefing  and  supervision 
of  instructors  and  students;  vital  supplementary  information  such  aa 
weather  reports,  training  curriculum,  and  flying  schedules.  The 
main  purposo  of  this  step  is  to  obtain  conclusive  data  on  tho  validities, 
reliabilities,  and  intercorrclations  of  the  measures  so  that  they  can  be 
weighted  and  combined  into  total  scores  to  produco  the  most  efficient 
results. 

RESULTS  OF  AN  OBJECTIVE  INSTRUMENT  CHECK  RIDE 
GIVEN  ON  EACH  DUAL  RIDE  « 

Tho  goal  of  tho  next  stngo  of  research  was  tho  development  of  on 
objcctivo  check  rido  to  mensuro  instrument  flying  skill  in  tho  TB-25. 
Whilo  tho  Psychological  Research  Project  (Pilot)  was  primarily  inter¬ 
ested  in  determining  tho  feasibility  of  objective  measures  of  instrument 
flying,  a  secondary  aim  was  tho  construction  of  a  standardized  check 
rido  which  could  bo  used  by  supervisory  and  instructor  personnel  in 
making  tho  prescribed  periodic  checks  of  instrument  flying  proficiency. 

•  Capt.  Wtn.  V.  n«rtn  and  fl/Pft.  .  W.  Ismael  of  tho  Wot  Projwt,  and  Capt.  D.  N.  Ilenderaon  and 
Lt.  Jack  O  Hein  of  tho  Instrument  Training  Squadron,  P«m;>a  Army  Air  Field,  assisted  In  tho  coostroo 
tlon  and  administration  of  tho  Instrument  measures  described  In  this  section.  8gt.  Ptra  Olaaar  wag  r*> 
sponsible  for  supervising  tho  statistical  analysis.  , 


A  comprehensive  study  was  made  at  the  Advanced  two-engine 
school  at  Pampa,  Tex.,  to  determine  the  reliability,  validity,  and  prac- 
ticnl  value  of  objective  measures  of  instrument  flying  skill.  This,  of 
course,  required  tho  preliminary  work  of  test  development  summon* 
ized  as  steps  1,  2,  and  3  in  the  preceding  section.  Tho  final  statistical 
analysis  of  tho  data  obtained  at  Pampa  Army  Field  represents  the 
completion  of  step  4.  The  end  of  tho  war  occurred  beforo  work  could 
be  started  on  the  final  phase,  step  5,  refining  tho  measures  for  appli¬ 
cation  in  the  routine  training  situation. 

Problem  , 

Tho  purpose  of  the  first  phase  of  the  study  was  to  determine  the 
reliability  and  validity  of  the  objective  measures  of  instrument 
flying  skill  when  administered  on  each  dual  ride.  It  was  highly 
advantageous  to  repeat  tho  objective  measurement  on  as  many  rides 
as  possible  since  other  studies  had  shown  that  tho  low  reliabilities  of 
objective  measures  were  caused  by  factors  producing  day-to-day 
variability  in  performance.  By  measuring  performance  on  eoch  dual 
ride  for  a  number  of  different  days,  these  factors  could  bo  averaged 
out  and  the  reliability  increased. 

The  problem  of  securing  a  satisfactory  criterion  for  validating  the 
objective  measures  was  complicated  by  the  fact  that  each  student 
usually  had  two  or  three  instrument  instructors,  no  ono  of  whom 
could  bo  expected  to  give  an  accurate  subjective  report  of  c.  student’s 
instrument  flying  skill.  Nevertheless,  the  instructors’  rankings  of 
their  students’  instrument  flying  ability  were  correlated  with  the 
average  objective  scores  A  second  validity  analysis  compared  the 
objective  scores  made  during  early  versus  later  hours  of  instrument 
training. 

Procedure 

The  check-ride  booklet. — A  34-item  check  was  designed  to  cover  the 
fundamental  instrument  maneuvers  which  were  practiced  at  least 
-  once  during  each  instructional  flight.  A  copy  of  this  booklet  is 
presented  in  appendix  table  A8.5.  Figure  8.2  gives  a  sample  set  of 
measures  showing  how  they  are  marked  by  the  check  pilot. 
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Fiouxe  8.2.— Samplo  measures  with  deviation  markings  by  tho  check-pilot. 
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To  score  these  measures,  tlio  check  pilot  simply  marked  the  highest 
and  lowest  deviations  on  the  altimeter,  air  speed,  and  heading  dials. 
Several  marks  in  the  samo  direction  of  deviation  could  bo  recorded  as 
tho  student  continued  to  increase  the  amount  of  altitude,  air  speed, 
or  heading  variation  during  tho  maneuver.  The  check  pilot  indicated 
tho  exact  starting  altitude  on  tho  dial  by  a  line  with  a  small  zero  on 
the  end  (?). 

Testing  procedures. — The  experiment  was  designed  to  fit  into  the 
training  conditions  with  minimal  disruption  of  tho  routine  flying 
schedule  of  students  and  instructors. 

At  least  20  hours  of  Advanced  flying  training  were  spent  in  instru¬ 
ment  flying,  divided  between  13  hours  dual  (with  instructor)  and  7 
hours  so-called  solo  (without  instructor  but  with  a  second  student, 
who  was  not  under  tho  hood,  watching  to  avoid  collisions  with  other 
planes).  Instrument  training  was  given  on  alternate  days  during 
tho  first  5  weeks  at  tho  Advanced  school.  When  not  receiving  instru¬ 
ment  training,  tho  students  continued  transition  flying  with  their 
contact  squadrons. 

Ordinarily,  at  least  six  dual  flights  were  given  during  the  5  weeks 
of  instrument  training.  Tho  instructors  gave  tho  objective  check 
during  the  first  part  of  each  dual  ride— before  instructing  the  student 
on  that  day’s  lesson.  Some  of  the  radio  measures  could  not  be  graded 
during  tho  first  rides  because  the  training  on  radio  procedures  had  not 
yet  begun. 

Tho  subjects  used  in  this  study  were  tho  80  students  in  flights  G 
and  II  in  class  45-D. 

Both  tho  students  and  tho  instructors  were  briefed  thoroughly  on 
tho  naturo  of  tho  objective  scalo.  The  instructors  were  indoctrinated 
os  to  how  tho  measures  were  to  bo  intcrp.eted,  administered,  and 
graded.  Representatives  from  tho  Pilot  Project  wero  present  at  all 
times  to  assist  in  tho  administrative  details,  maintain  a  log  of  weather 
conditions  nnd  flight  schedules,  and  to  facilitate  tho  maintcnanco  of 
standard  testing  conditions  in  all  aspects  of  tho  study. 

Results 

Reliability  oj  scores  made  on  odd  v.  even  days. — The  odd-oven  relia¬ 
bility  of  each  of  tho  34  measures  in  tho  daily  check  rido  was  obtained 
by  correlating  tho  averages  of  tho  scores  made  on  alternate  rides. 
If  a  test  is  rcliablo  (consistent)  a  student  who  enrned  high  scores  on 
oven  numbered  rides  should  also  have  high  scores  on  his  odd  numbered 
rides;  tho  student  who  scores  ’^w  on  ono  set  should  bo  low  on  both. 
Sinco  either  tho  odd  or  tho  c  .ides  arc  only  half  of  tho  total  given, 
it  was  necessary  to  apply  th  ^earman-Brown  correction  to  estimate 
tho  reliability  of  both  sets  ol  rides  taken  together.  Table  8.5  on  th© 
following  pages  presents  theso  corrected  coefficients.  Appendix 
tablo  A8.6  gives  tho  moro  detailed  summary  statistics. 
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Tablf.  8.5. — Reliability  of  each  objective  meature  in  the  TB-S5  daily  check  rid « 
(Based  on  Average  Scores  of  Three  Odd  ».  Three  V.vcn  Days  Corrected  for  Double  Lcnrth  •] 


Mtasuraa 

Te.<t-ret*st 

reliability 

N 

A.  Instrument  Itkt-ef: 

1.  Instructor  help  keep  on  ruowsy... . 

0.08 

.26 

*.29 

88 

2.  Attitude  in  Initial  climb . 

70 

79 

3.  Air  «i>eed  ranee  in  climb  to  4,000  feet  . 

D,  Spiral  climb: 

4.  Air  speed  In  climb  4,000-5,000  feet . 

-.21 

!  74 

71 

5.  Air  speed  In  climb  5,000-5.000  feet . 

—.03 

6.  Air  sbeed  in  climb  5.000-7.000  feet— . 

.17 

•*.39 

71 

70 

78 

77 

O.  Lerelout: 

7.  Heading  durlnf  level  out . 

8.  Altitude  during  level  out . 

Ml  41 

D.  ISO’ turn. 

9.  Time  error  In  180*  turn . 

•  17 

10.  Altitudo  range  In  ISO*  tum . 

•••.84 

77 

11.  Hendlnr  at  roll-out  of  ISO*  turn . . . . . 

-.10 

.18 

77 

E.  1'artlal  panel  turn: 

12.  Time  error  In  partial  panel  turn- . 

77 

13.  Altitude  range  In  partial  panel  tum . 

78 

77 

7| 

14.  Heading  at  rollout  In  pohlal  panel  turn . 

.11 

*.31 

F.  Fairer  let -ioion: 

15.  Heading  rnngo  during  air  speed  changs..._ . 

19.  Altitude  range  during  air  speed  change. . . 

.23 

70 

17.  Did  student  complete  OUMPcheckI . 

.28 

Tfi 

18.  Heading  range  at  level-out . 

*.38 

71 

TO 

70 

19.  Altitudo  range  at  level-out . . 

••*.48 

20.  Air  speed  range  at  level-out . . . 

.23 

O.  Single-engine  operation: 

21.  Heading  range  during  single-engine  operation . . 

.21 

70 

22.  Altitudo  rango  during  slnglc-englno  operation.... . . . . 

*.33 

71 

23.  l/owesl  air  speed  reached  during  single-engine  operation. . 

*.31 

70 

H.  Bad! o  procedure:’ 

24.  Tune  in  and  Identify  proper  station.. . 

-.08 

07 

25.  Check  directional  gyro..’ . . 

•••.5ft 

00 

25.  Heading  range  while  tuning  radio.. . 

-.05 

81 

27.  Altitude  rnngo  while  tuning  radio.. . 

•.33 

80 

28.  Air  speed  range  whilo  tuning  radio- . 

.17 

00 

I.  Quadrant  identification: 

29.  Recognize  fade  or  build . . . . . . . 

”.50 

08 

3.  Peam  rroitlng: 

30.  When  started  tum  after  crossing  beam. . . . . . 

-.28 

00 

K.  SfoJlon  recognition: 

31.  Error  In  seconds  when  crossed  eon* . . . 

*.17 

07 

L.  Let-down  and  low  approach: 

3?.  Posit  Inn  when  slpnnl  over  field  In  let-down . . . 

-.29 

27 

11.  Time  error  of  letKlown  from  cone  to  field.. . . . 

.11 

00 

M.  Voice  procedure: 

.12 

10 

Probability  of  obtaining  a  positive  cnnvUtlon  of  tbit  (Ire  by  cb&oce  (lone 
No  asterisk  — more  than  10  tlmci  In  100. 

•- 10  times  In  100  or  led. 

••-2  5  times  In  100  or  lost. 

•••-0.5  times  In  100  or  leu.  .  , 

Means,  standard  deviations,  uncurrvcted  odd-even  reliabilities  and  slgnMconce  levels  are  given  In  lb* 
appendix  table  A 8.0. 

•  For  the  mdlo  measures  f24-34)  only  2, 3,  or  4  separate  scores  could  be  obtained,  since  these  procedural 
were  Introduced  later  In  training. 


Tho  results  in  tablo  8.5  show  that,  ns  a  group,  the  altitudo  mensures 
have  the  best  reliabilities,  sinco  G  of  tho  10  measures  with  positive 
correlations  significant  at  tho  2.5-perccnt  level  aro  altitudo  items. 
Tablo  8.6  gives  tho  distribution,  showing  tho  rango  of  corrected  odd- 
even  reliabilities  for  tho  34-itcm  objective  scale. 

Table  8.6. — Distribution  of  corrected  odd  day-even  day  reliabilities 


{ Median -0  23| 


Corrected  reliability 

Frequency 

Corrected  reliability 

Frequency 

3 

9  31  to  0,48 . 

7 

—O  11  tn  — O  30 . . 

0 

0.41  toO  ffl . 

8 

-4-0  OO  to  —O  10  . 

4 

0.51  to  0.50 . 

8 

±0.00  to  +0.10 . 

1 

Over  O.CO . 

t 

+0.11  to  +020 . 

+0.21  to +0  30  •  •  .  . 

7 

0 

Total . 

84 
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In  the  original  design  of  the  experiment  it  was  planned  to  have 
each  student  gradcd  by  the  samo  instructor  on  all  but  one  rido,  on 
which  ho  would  bo  graded  by  a  different  instructor,  in  order  to  deter¬ 
mine  tho  effect  of  instructors  on  day-to-day  reliability.  However,  it 
was  administratively  necessary  for  tho  instrument-training  super¬ 
visory  personnel  to  switch  instructors  from  student  to  student  at 
frequent  and  uncontrolled  intervals  throughout  the  5  weeks  of 
instrument  training.  As  a  result,  most  students  had  either  two  or 
threo  different  instructors  on  their  6  dual  rides  when  tho  objective 
checks  were  given.  Tho  odd-even  reliabilities  reported  in  table  8.5 
include  any  effect  resulting  from  this  changing  of  instructors  which 
was  fairly  well  randomized  throughout  tho  instrument  training. 

In  order  to  determine  whether  having  different  amounts  of  flying 
time  for  tho  odd  and  even  days  had  any  effect  on  the  reliability 
coefficients,  semipartial  correlation  coefficients  partialing  out  total 
TB-25  time,  wero  calculated  for  threo  measures,  Nos.  9,  13,  and  15, 
having  low,  high,  and  intermediate  reliabilities.  The  reliabilities 
could  havo  been  distorted  if  somo  students  had  consistently  more 
flying  timo  (thus  moro  possibility  for  learning)  on  one  set  of  rides 
than  on  tho  other.  Since  the  semipartial  correlations  were  found  to 
bo  almost  identical  with  the  uncorrcctcd  reliabilities,  no  further 
control  for  tho  "flying  timo”  factor  was  made.  Tho  results  are  given 
in  appendix  table  A8.7. 

Tho  rango  of  reliabilities  in  table  8.5  is  about  the  some  as  that 
obtained  in  other  studies  in  which  the  students  wero  given  tests  on 
two  different  days.  On  tho  basis  of  theso  previous  results  one  might 
havo  expected  tho  reliabilities  of  measures  given  on  6  days  to  be 
somewhat  higher.  Tho  distribution  of  low  reliabilities  presented  in 
tablo  8.G  emphasizes  tho  importance  of  tho  many  variable  factors 
operating  in  pilot  testing  procedures:  different  planes  from  day  to 
day;  variable  weather  and  turbulence;  different  kinds  and  amounts 
of  interpolated  flying;  different  instructors;  different  motivation  and 
attitudes,  and  differential  rates  of  learning.  Tho  homogeneity  of  the 
group  mado  tho  influence  of  these  factors  greater  than  thoy  might 
havo  been  with  a  group  of  students  representing  a  wider  rango  of 
flying  abilities.  The  students  tested  had  all  been  screened  with  the 
samo  battery  of  aptitude  tests  and  had  received  similar  training 
in  tho  Primary  and  Basic  schools,  where  the  weaker  students  were 
eliminated. 

Comparison  of  scores  made  at  two  different  levels  of  training. — One 
typo  of  validity  of  tho  objcctivo  instrument  measures  can  bo  estimated 
by  comparing  scores  mado  at  two  different  levels  of  training.  Pre¬ 
sumably  students  should  make  better  instrument  scores  os  training 
progresses  and  tho  valid  moosurcs  should  show  these  difforencos.  A 
comparison  was  therefore, mado  between  objcctivo  scores  obtained  on 
tho  second  versus  tho  sixth  rides. 
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Twenty-two  measures  were  selected  for  further  analysis  on  the 
basis  of  their  learning  curves,  and  on  tho  basis  of  whether  or  not  they 
covered  an  important  area.  The  results  aro  presented  in  tablo  8.7. 
This  table  shows  tho  level  of  significance  of  tho  mean  difference 
between  tho  two  rides. 

Of  tho  22  measures  analyzed,  13  aro  significant  at  tho  1  pcrcont 
level,  and  17  at  tho  5  percent  level,  leaving  only  5  objcctivo  measures 
with  differences  which  might  reasonably  bo  expected  by  chanco  alono. 
Four  of  theso  5  nondiscriminating  mcasuro9  aro  radio  items  in  which 
tho  comparison  was  between  tho  fourth  and  sixth  rides  rathor  than 
between  tho  second  and  sixth  as  with  tho  nonradio  measures.  (Radio 
procedures  were  not  introduced  until  later  in  training.) 

Theso  results  can  bo  interpreted  as  demonstrating  that  tho  objcctivo 
measures  of  instrument  flying  skill  reflect  improvement  in  proficiency 
and  can  be  accepted  as  valid  within  tho  limits  of  tho  study.  It  may 
bo  concluded  that  theso  objective  measures  aro  sufficiently  sensitive 
to  measure  any  important  differences  between  groups  which  havo 
received  different  amounts  or  types  of  training  or  different  oppor¬ 
tunities  to  forgot. 

Correlation  between  objective  scores  and  instructors '  subjective  rank • 
ings. — At  tho  end  of  training,  each  instructor  ranked  his  students  on 
tho  basis  of  over-all  instrument  flying  ability.  Theso  rankings  were 
then  used  as  a  criterion  against  which  to  validate  tho  objcctivo  scalo 
scores.  The  objcctivo  score  used  for  each  student  was  tho  average  of 


Table  8.7. — Differences  between  objective  inetrument  check-ride  scores  on  early  and 

late  rides 1 


Measures 

N 

Mean 
difference  • 

S.  1).  mean 
(inference 

P' 

32 

l.ono 

a  370 

a  oaio 

3.  Air  speed  ranpo  Iri  cllmh  to  4,000  feet..— . . 

32 

.ins 

.243 

.0002 

31 

.  012 

.  11*7 

•  ■f  i.vr  ] 

■  1 

.714 

.174 

.0001 

m  1 

1.0*1 

.171 

.0004 

7.  Heading  *  In  ring  level  out... . 

IB. 

.714 

.142 

49 

.  42V 

.  144 

.awo 

6.  Time  error  In  lfO*  turn . 

SO 

.210 

.IIS 

.0  tra 

10.  Altitude  range  In  ISO*  turn . . . . . 

u 

.313 

.233 

■m 

13.  Altitude  range  In  partial  panel  turn . . 

44 

1.  tot 

.212 

.OuoO 

10.  Altitude  range  during  A/.^  chitnce . 

43 

1. 010 

.210 

.0*00 

47 

.I'M 

•  I4H 

.OJUO 

47 

.310 

.173 

.am 

44 

.470 

.  2S't 

.0004 

43 

.t*M) 

.217 

.0000 

41 

.103 

.  2IH 

.11*00 

33 

.4(1) 

.IN) 

.0130 

32 

.  IS4 

.213 

.2300 

34 

,C*>7 

.77 2 

.0)3) 

30 

.433 

.197 

.0240 

31 

-on 

.144 

27 

222 

.404 

.3900 

•  Second  and  ilith  <1*11/  checks  for  basic  measures  (numbers  3-23);  fourth  and  tilth  fur  radio  mcasurra 

(numbers  25-31).  ...  .  .  .  ...  . 

i  The  incnn  difference  was  compute*!  from  the  algebraic  sum  of  the  difference*  (*cuff  more  training  mintu 
•core  K\m  tratiiin?)  of  coded  fuure%  an  l  the  $.  I),  wa*  rufiijHitrl  from  (tils  kfb  of  dlifrf t-uceJ.  A  twlllvt 
number  moans  that  the  .Undents  were  heller  after  more  training.  ...  ..  .  , 

*  Probability  of  obtaining  by  chance  •  dtllcrcnce  In  favor  of  mutt  training  at  large  at  the  one  observe*!. 
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all  his  daily  rides.  Only  those  measures  with  reliability  coefficients 
of  0.29  or  better  were  used  for  this  analysis.  The  results  are  pro* 
sented  in  table  8.8. 


Table  8.8. — Correlation  between  average  daily  objective  instrument  tcoret  and  in- 

elructor’s  subjective  rank  order 


Measure 

N 

r 

PI 

1  Air  M'oH  mnw  In  climb  to  4,000  feet . . 

71 

0.18 

007 

7.  Ilt-adli  g  .luring  level  out . 

71 

.IS 

.11 

8.  Altdude  luring  level  out . 

71 

.04 

.37 

9.  Time  <  rr  r  In  ISO*  turn.,  . .  . . 

71 

.24 

.02 

10.  Altitude  r.uige  In  ISO*  turn  . 

71 

.23 

.03 

13.  A  It  It  u<lc  r  mge  In  partial  |wnol  tum . . 

71 

.18 

.07 

15,  tl<  ruling  range  during  A/S  change  In  power  let-down . 

71 

.09 

.23 

IH.  Mending  runre  at  level-out  In  power  let-down . 

71 

.40 

19.  Altitude  range  nt  level-out  In  [>ower  let-down . 

71 

.14 

.11 

22.  Altitude  range  during  single-engine  operation . 

23.  Lowest  air  a|>ccd  reached  during  single-engine  operation.. . . . 

71 

.04 

.37 

70 

.00 

.30 

Radio  Prottdurtl 

2A.  Check  directional  gyro . 

09 

.20 

.05 

27  Altitude  rango  while  tuning  radio . 

71 

.04 

.38 

29.  Itecognlre  fade  or  build  . 

70 

.09 

.24 

31.  Krror  In  seconds  w  hen  crowd  cone . 

OS 

.10 

.00 

i  Probability  of  obtaining  positive  coefficients  of  this  slio  by  chanc«  alone. 


Only  3  of  tho  15  measures  reach  the  5-pcrccnt  level  of  significance 
for  positivo  correlations.  Tho  failuro  of  tho  other  measures  can 
probably  bo  accounted  for  by  two  conditions: 

(1)  Thcro  wero  a  great  many  changes  between  instructors  and 
students  during  tho  period  of  instrument  trnining.  Several  instruc- 
tors  reported  that  they  had  flown  with  their  originally  assigned 
students  on  only  ono  or  two  rides.  Therefore,  not  much  weight  can 
bo  placed  on  tho  accuracy  of  theso  subjective  ratings. 

(2)  Being  an  averago  of  all  rides,  the  objective  scores  reflect  both 
early  and  lato  performance.  Tho  instructors’  ratings,  on  tho  other 
hand,  wero  based  on  final  instrument-flying  performance  or  final 
ability  estimated  on  tho  basis  of  a  few  rides  in  tho  earlier  stages  of 
training. 

Comparison  of  the  range  and  limits  methods  of  scoring. — Earlier  it 
was  pointed  out  that  the  range  score  includes  tho  maximum  deviations 
in  both  directions  while  the  limits  score  is  based  on  the  greatest  single 
deviation  from  tho  initial  instrument  reading.  The  problem  was  to 
determine  which  of  tho  two  methods  showed  tho  greatest  differences 
between  student  performance  on  the  second  versus  tho  sixth  rides. 
Tho  data  wero  taken  from  tho  34-item  daily  objective  instrument 
check  rido  which  permitted  both  types  of  scoring.  Ten  items  repre¬ 
senting  measures  of  heading,  altitude,  and  airspeed  wero  used  in  this 
analysis.  It  was  assumed  that  the  method  which  reflected  the  greatest 
improvement  was  tho  moro  valid  measuro  of  instrument  flying  skill. 
The  results  aro  presented  in  tablo  8.9. 

Examination  of  this  tablo  shows  that  larger  differences  were 
secured  by  tho  rango  method  on  six  measures  and  by  tho  limits 
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method  on  four.  What  little  difference  thcro  is  in  the  over-all 
picture  seems  to  bo  in  favor  of  the  rango  method  again,  but  the 
differences  arc  so  inconsistent  that  they  could  cosily  havo  been  pro¬ 
duced  by  chance. 


RESULTS  OF  A  COMPREHENSIVE  OBJECTIVE  CHECK  RIDE 
TO  MEASURE  FINAL  INSTRUMENT  FLYING  SKILL 

The  personnel  supervising  instrument  training  wero  particularly 
anxious  for  the  objective  measures  to  bo  used  to  yield  evidence 
relevant  to  the  following  problems: 

а.  Docs  the  use  of  a  standardized  daily  check  improvo  tho  final 
level  of  instrument  flying  proficiency? 

б.  How  well  is  instrument  flying  skill  retained  after  formal  in¬ 
struction  has  ended? 

c.  Is  it  feasible  to  construct  a  comprehensive  standardized  check 
ride  for  use  in  evaluating  tho  instrument  flying  proficiency  of  students 
piior  to  graduation? 

To  help  answer  theso  problems  the  Pilot  Project  constructed  a 
70-item  final  instrument  check  rido.  Tho  maneuvers  selected  for 
testing  were  thoso  prescribed  by  AAF  memorandum  50-3,  which 
defines  the  standardized  instrument  flight  check  used  throughout  the 
Air  Forces  to  check  tho  instrument  flying  proficiency  of  rated  pilots 
at  yearly  intervals,  and  which  was  also  used  to  evaluato  student 
pilots  just  prior  to  graduation. 


Table  8.9. — Difference*  between  Second  and  Sixth  dual  ride <  a*  meatured  by  tho 

range  and  the  limit t  method i 


Mtosurt  i 

# 

Limits  method 

Range  method 

IV 

Mean 
differ¬ 
ence  • 

8.  D. 
menn 
differ* 

enoe 

a 

N 

Mean 

differ* 

enoe  * 

8.  D. 
mean 
differ* 
enoe 

r* 

3.  Air  speed  ranee  In  clltnh  to 

4,000  feet . 

8.  Air  speed  In  climb  8,000-8,000 

feet . 

7.  Heading  during  level-out . 

10.  Altltudo  range  In  ISO*  turn.... 
13.  Altitude  range  In  partial 

panel  turn . 

18k  Altitude  range  during  air 

speed  change . 

19.  Altitude  ranga  at  lorel-out _ 

31.  Heading  range  during  8-E 

operation .  . 

38.  Heading  range  while  tuning 

radio  . 

33.  Air  speed  range  while  tuning 
radio . 

33 

43 

47 

48 

47 

47 

a 

48 

31 

SO 

a  47 

.82 

.84 

.40 

L  19 

.98 

.17 

.78 

.19 

.87 

0.23 

.17 

.31 

.18 

.31 

.38 

.10 

.38 

.19 

.31 

0.018 

.001 

.038 

.016 

.000 

.000 
.  i<7 

.001 

.188 

.003 

33 

39 

49 

48 

48 

43 

47 

48 

33 

30 

0.04 

.73 

.71 

.31 

MO 

1.04 

.34 

.97 

.19 

.43 

a  27 

.19 

.18 

.31 

.31 

.34 

.17 

.38 

.31 

.30 

a  ooo 

.000 

.000 

.000 

.ooo 

.ooo 

.031 

.ooo 

.330 

.008 

i  Second  and  ilxth  dally  checks  for  tasle  Items  (numbers  3*31);  fourth  and  slitb  for  radio  Hems  (numbers 
38  and  28). 

•  The  mean  difference  was  computed  from  the  algebraic  rum  of  the  difference*  (score  more  training  minus 
icoro  lew  training)  of  coded  scores  and  the  8.  I>.  was  computed  from  the  Series  of  differences.  A  poeltlra 
number  mean*  that  the  student*  were  better  after  more  training. 

1  Probability  of  obtolnlnc  by  chance  a  difference  of  Ibis  sUc  In  farcr  of  the  score*  based  oo  more  tralnlnf. 
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Tho  measures  were  scored  in  tbe  samo  manner  as  in  the  34-item 
daily  check  ride.  In  order  that  tho  student  would  know  exactly 
how  to  make  his  best  score,  the  first  page  of  this  longer  check  ride  had 
a  scoring  box  showing  tho  score  points  for  each  unit  of  instrument 
deviation.  The  score  points  for  tho  procedural  measures  were  indi¬ 
cated  in  parentheses  with  each  item.  Twenty  of  tho  measures  were 
identical  with  those  included  in  tho  short  daily  check-ride  booklet. 

Effect  of  Daily  Objective  Cheek  Ride  on  Proficiency  at  the  End  of 
Instrument  Training 

Tho  personal  reports  of  instructors  using  tho  daily  check  ride  were 
favorable.  After  tho  completion  of  the  Pampa  experiments,  many 
instructors  continued  to  use  tho  booklet  as  a  guide  for  their  teaching 
and  grading.  The  objective  instrument  readings  and  procedures 
were  particularly  helpful  during  the  recapitulation  of  tho  training 
flights  after  tho  instructor  and  his  students  returned  to  the  ready 
room.  Tho  instrument  training  personnel  suggested  that  this  type 
of  grading  system  he  modified  for  use  ns  the  daily  grade  slip.  In  the 
light  of  this  favorable  comment,  tho  administrative  personnel  wanted 
to  sccuro  any  evideneo  possible  on  tho  effect  of  using  tho  34-item 
objective  check  rido  during  tho  first  port  of  each  period  of  dual 
instruction. 

Sinco  only  one  of  tho  two  flights  in  tho  instrument  training  squad¬ 
ron  used  tho  34-item  objective  check,  it  was  possible  to  determine 
tho  effect  of  the  use  of  this  check  on  student  proficiency  at  tho  end 
of  instrument  training  when  both  flights  were  given  the  70-item 
objective  final  check.  Fourteen samplo measures  wero  selected  for  this 
analysis,  nine  measures  were  common  to  both  tho  daily  and  tho  long 
final  check,  whilo  fivo  occurred  only  in  tho  objective  final  check.  The 
results  are  presented  in  table  8.10. 

In  11  out  of  tho  14  measures,  the  experimental  flight  (using  the 
daily  objective  tests)  was  superior  to  tho  control  flight.  Tho  differ¬ 
ences  on  tho  three  measures  which  favored  tho  control  flight  were  all 
small.  On  5  of  tho  14  measures,  tho  difference  in  favor  of  tho  experi¬ 
mental  flight  was  significant  at  tho  1-perccnt  level  or  above.  These 
fivo  items  represent  measures  of  air  speed,  altibudo,  heading,  and  pro¬ 
cedures,  but  no  clear-cut  explanation,  in  terms  of  tho  pilot  skills  being 
measured,  is  apparent  to  indicato  why  theso  particular  measures 
should  show  significant  differences  whilo  others  do  not. 

One  of  tho  main  goals  of  instrument  flying  is  prcciso  control  of 
heading,  air  speed,  etc.,  os  indicated  by  deviations  on  tho  instruments. 
This  is  exactly  what  tho  objective  items  measured.  It  seems  likely, 
therefore,  that  tho  superiority  of  tho  experimental  group  represents  a 
significant  improvement  produced  by  tho  moro  rigorous  conditions  of 
daily  grading.  Tho  effects  of  this  procedure  on  other  aspects  of  tho 
performance  remain  to  bo  determined. 
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Level  of  Instrument  Flying  Skill  4  Weeks  After  the  End  of  Formal 
Instrument  Training 

Approximately  4  weeks  after  formal  instrument  training,  tho  long 
70-item  check  was  again  administered  to  tho  same  students  tho  last 
week  before  graduation.  At  this  timo  tho  students  were  given  a 
final  cheek  on  their  instrument  flying  skill  by  repeating  tho  AAF 
50-3  check  ride  which  they  had  to  pass  again  in  order  to  grnduato. 
The  objective  chcck-rido  booklet  was  administered  by  an  instructor 
who  had  never  flown  with  tho  student  beforo.  Ten  measures  repre¬ 
senting  tho  more  common  i/pcs  of  items  (altitude,  heading,  air  speed, 
procedure)  were  selected  for  this  analysis.  The  cessation  of  hostilities 
prevented  more  complete  analyses  using  all  of  tho  70  measures  in  tho 
objective  final  check-ride  booklet.  Tho  results  are  presented  in 
table  S.ll. 


Table  8.10. — Difference*  between  $  core*  on  the  final  instrument  cheek  rid*  of  students 
using  the  daily  objective  check  and  a  control  group 


Measure  ■ 

N 

!|| 

8.  n. 

differ¬ 

ence 

JM 

Control 

group 

111 

3.  Air  speed  range  In  climb  to  4,000  foot . 

M 

63 

0.91 

6187 

'  6001 

7.  Ilcadlng  during  lovel-out . 

04 

67 

,  16 

.314 

13.  Altitude  rangoln  partial  panel  turn . 

03 

OS 

.63 

.317 

.000 

is.  Ilcadlng  range  during  air  speed  change . 

M 

66 

.63 

.271 

.006 

17.  Did  student  complete  GUMP  check . 

M 

63 

.03 

.187 

490 

22.  Altitude  range  during  S-E  operation . 

00 

63 

.33 

.249 

.100 

28.  Air  speed  range  while  tuning  radio . 

M 

66 

.19 

.003 

.003 

31.  Error  In  seconds  when  crossed  cona . . 

39 

GO 

IS 

.383 

32.  Position  when  ilgnal  over  field . 

U 

63 

.17 

.173 

.160 

A.  Altitude  In  steep  turn. . 

00 

68 

.38 

.319 

.100 

B.*  Brain  following . 

61 

67| 

.09 

.033 

.6V> 

C.  Air  speed  In-bound  to  low  cone . 

37 

68 

.61 

.183 

.003 

D4  Position  ft!  low  com . . 

34 

64 

•-.08 

.346 

E.  Altitude  at  field . 

49 

67 

.30 

.319 

.100 

»  Measures  3  through  33  were  common  to  tbo  dally  and  tho  final  check  rides;  measures  A  through  S  war* 
In  the  long  chock  only.  * 

•  The  control  group,  which  did  not  uso  dally  objective  check,  secured  a  higher  score  than  the  eiperlmonUl 
group  which  usod  this  check-ride. 

*  Probability  of  obtaining  by  chance  a  difference  of  this  site  In  fevor  of  tho  eipcrimental  group. 


Table  8.11. — Comparison  of  objective  score »  on  the  70-item  check  ride*  separated  bp 

an  interval  of  4  weeks 


Measure 

AT 

Mean 

difference 

8.D. 

difference 

PI 

A.  Air  spccsl  In  Initial  climb .  . 

91 

613 

6IM 

6100 

177 

-.09 

.138 

C.  Altitude  In  8-K  opcmt Ion . . . . 

IIS 

-.09 

.170 

D.  Heading  In  level -out . . . . 

129 

.38 

.133 

.011 

F  Altitude  In  partial  panel  turn  (left).. . . 

123 

.06 

.139 

.348 

K.  I'o'Itlon  At  low  coni . . . 

116 

.to 

.184 

.001 

O,  Procedure  In  let-down . . 

113 

.03 

.140 

.441 

99 

.10 

•  188 

.393 

123 

-.03 

.133 

III 

.04 

.133 

.394 

i  Probability  of  obtaining  by  chaooa  a  difference  of  tbU  else  In  favor  of  tbo  toeta  given  at  tho  rod  of  training. 
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In  general,  tho  differences  between  the  two  administrations  were 
small  and  inconsistent.  Sovcn  out  of  the  ten  differences  were  in  favor 
of  tho  scores  obtained  at  tho  end  of  training;  two  of  theso  were  sig¬ 
nificant  at  approximately  tho  1  percent  level.  This  would  seem  to 
indicato  that  general  effects  of  additional  contact  training  and  tho 
specific  instrument  practice,  which  tho  students  gave  themselves 
during  tho  solo  periods  immediately  preceding  the  final  check,  coun¬ 
teracted  any  tendency  to  forgot  during  the  4  weeks  following  tho 
end  of  formal  instrument  instruction. 

SUMMARY  OF  OBSERVATIONS  MADE  DURING  ADMINISTRA¬ 
TION  OF  THE  OBJECTIVE  INSTRUMENT  CHECK  RIDES 

In  addition  to  the  statistical  results  of  the  Pampa  studies,  the  fol¬ 
lowing  information  was  gained  about  tho  construction  and  adminis¬ 
tration  of  objective  measures  of  flying  skill: 

1.  Insofar  as  possible,  tho  measures  should  bo  constructed  aad  de¬ 
veloped  in  closo  conjunction  with  the  personnel  at  tho  station  having 
tho  responsibility  of  final  administration.  This  helps  to  indoctrinate 
theso  pilots  and  to  motivato  them  to  accept  the  controls  required  for 
experimental  administration,  e.  g.,  switching  instructors  for  the  final 
chocks. 

2.  Whcnovcr  possiblo  tho  items  should  bo  adapted  to  tho  specifio 
conditions  of  the  school  giving  the  checks,  e.  g.,  traffic  pattern  alti¬ 
tudes,  air  speed,  etc.  This  makes  it  easier  to  obtain  maximum  clarity 
of  instructions  and  helps  to  minimize  tho  novelty  of  tho  check  ride.* 

3.  It  is  sometimes  necessary  to  compromise  strict  objectivity  to 
include  subjcctivo  measures  of  vital  aspects  of  somo  maneuvers  which 
aro  not  adapted  to  objective  grading,  e.  g.,  volume  control  during  radio 
rango  procedures. 

4.  Research  personnel  must  bo  continually  present  to  supervise 
every  detail  of  tho  experimental  administration,  e.  g.,  maintaining  a 
dotuiled  log  of  unavoidable  day-to-day  variations  of  procedure  such  os 
tho  effect  of  adverso  weather  conditions,  and  abnormalities  of  the 
schcdulo  produced  by  chemical  warfare  lectures,  military  parades,  and 
other  interfering  factors. 

5.  Somo  arrangement  should  bo  mado  whereby  the  local  supervisory 
and  instructor  personnel  who  aro  doing  extra  work  will  bo  shown  as 
soon  ns  possiblo  somo  results  of  a  typo  which  aro  interesting  to  them. 
For  cxamplo,  plotting  of  learning  curves  on  six  measures  during  the 
daily  checks  at  Pampa  was  effective  in  maintaining  tho  interest  and 
cooperation  of  instructors. 

Possible  Uses  of  Such  Scales 

Pilots  responded  favorably  to  these  scales;  their  comments  and  sug¬ 
gestions  were  encouraging.  They  recognized  two  of  tho  more  practical 
applications  of  this  typo  of  measuring  instruments:  (1)  A  more 
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objective  find  standardized  check  rido  which  could  bo  used  in  place  of 
the  ono  specified  in  AAF  Regulation  50-3  whenever  it  is  necessary  to 
select  pilots,  individually  or  in  groups,  on  the  basis  of  instrument 
flying  skill;  (2)  an  objective  doily  grade  slip.  This  may  ultimately 
bo  tho  most  valuable  application  of  theso  objective  measures  since  it  is 
only  by  repeated  tests  of  tho  same  students  that  tho  large  day-to-day 
variations  can  bo  balanced  out. 

These  objective  measures  have  potential  valuo  also  as  a  means  of 
measuring  tho  results  of  training  experiments  and  stating  tho  effects 
of  such  factors  as:  different  kinds  and  amounts  of  instruction  in 
special  ground  training  devices,  e.  g.,  Link  trainer;  transfer  of  training 
from  ono  type  plane  to  another;  different  methods  of  scheduling 
(distributing)  instrument  training.  Objcctivo  scores  also  permit  a 
more  precise  and  clear  description  of  tho  curves  of  learning  and 
forgetting.  Finally,  such  scales  may  be  used  as  a  criterion  for  vali¬ 
dating  parts  of  tho  selection  and  classification  battery. 

A  RECOMMENDED  FINAL  INSTRUMENT  OIECK-RIDE 

FOR  THE  TB-25 

Tho  many  changes  in  tho  Training  Command  following  tho  ond  of 
the  war  made  it  impossiblo  to  continuo  tho  statistical  analysis  of  tho 
two  objcctivo  instrument  scales  for  tho  TB-25.  For  this  reason, 
Step  5  of  the  outline  of  objective  test  development,  pago  100,  was 
nover  completed.  However,  a  rovised  form  of  tho  final  check-ride 
booklet  was  made  and  criticized  by  expert  instrument  pilots  at  throe 
different  two-engino  schools. 

These  specialists  wero  asked  to  includo  any  and  all  aspects  of 
instrument  flying  skill  which  aro  considered  important  in  a  final 
check  ride.  As  a  result,  wherovor  an  important  aspect  of  a  manouvor 
could  not  bo  measured  accurately  in  objcctivo  terms,  subjective 
measures  were  included.  Howovor,  tho  total  number  of  strictly  sub¬ 
jective  measures  was  rather  small,  27,  compared  to  tho  92  objective 
measures  in  tho  total  scale.  Tho  most  common  snbjcctivo  item  is  an 
evaluation  of  tcchniquo  which  is  included  in  most  of  tho  maneuvers. 

A  copy  of  tho  scalo  is  given  in  appendix  tablo  A8.8,  Tho  primary 
purpose  of  this  revised  scalo  is  to  servo  as  a  samplo  of  tho  typo  of 
standardized  final  instrument  check  ride  which  might  bo  used  for 
checking  graduating  students  as  well  os  rated  pilots  being  reoxamined 
for  tho  AAF  50-3  "white"  instrument  cord.  Tho  maneuvers  includod 
in  this  check  were  tho  ones  proscribed  during  tho  late  summer  of  1945. 

.  DEVELOPMENT  OF  INSTRUMENT  SCALES  AT  TOE 
FOUR-ENGINE  LEVEL 

Four-engine  aircraft,  particularly  tho  TB-24  ond  tho  TB-20,  aro 
frequently  referred  to  os  "instrument  ships"  sinco  tho  pilot  sits  for¬ 
ward  of  tho  wings  and  does  not  havo  cosy  reference  to  tho  position 
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of  tho  wing  on  tho  horizon  os  an  aid  in  controlling  the  attitude  of 
tho  piano.  Therefore,  instruments  such  as  the  flight  indicator  and 
tho  rato  of  climb  indicator  are  habitually  used  to  control  the  attitude 
of  tho  aircraft.  Sinco  four-engino  planes  frequently  mako  long-range 
flights,  the  pilot  must  also  bo  prepared  to  fly  by  instruments  at  night 
and  through  poor  weather  conditions.  Many  experienced  pilots  hold 
tho  opinion  that  instrument  flying  skill  is  the  most  important  single 
pilot  requirement  for  superior  performance  when  flying  four-engine 
aircraft. 

For  theso  reasons,  tho  Pilot  Project  constructed  an  instrument 
scalo  for  use  at  the  four-engine  level,  but  the  end  of  the  war  pre¬ 
vented  conducting  an  experiment  to  obtain  statistical  data  on  relia¬ 
bility  and  validity. 

The  First  TB-24  Seale  Developed  at  Fort  Worth  Army  Air  Field 

This  scalo  combined  both  contact  and  instrument  measures.  This 
was  advisable  in  order  to  utilize  the  flying  time  of  the  planes  and  the 
students  sinco  it  was  not  possible  to  schedule  flights  for  testing  instru¬ 
ment  items  alono.  The  first  draft  contained  118  separate  measures; 
after  flight  testing  with  a  few  students  this  was  reduced  to  87  meas- 
ures.  „ 

Fifteen  TB-24  Transition  student  officers  were  tested  with  this 
scalo;  eight  were  rated  by  instructors  ns  being  excellent  student  pilots 
and  seven  wero  judged  mediocre  or  weak  TB-24  pilots.  No  statis¬ 
tical  analyses  were  made  of  the  results  of  this  testing.  Scores  were 
distributed,  however,  for  the  two  groups  and  the  data  inspected  for 
any  apparent  differences  or  trends.  These  wero  taken  into  account 
in  tho  later  revisions  of  the  four-engine  instrument  scale.  The  many 
hours  which  personnel  from  the  Pilot  Project  spent  observing  and 
scoring  tho  ecalo  helped  them  to  see  ways  in  which  objective  measures 
could  bo  improved. 

Four-Engine  Instrument  Seales  from  Other  Sources 

In  preparation  for  the  final  revision  of  the  TB-24  instrument  scale, 
a  survey  was  made  of  similar  work  being  done  elsewhere  at  tho  four- 
engino  Transition  level.  Two  examples  of  tests  of  this  sort  were 
found  which  had  a  reasonable  degreo  of  objectivity.  Theso  were  the 
“Instrument  Flight  Cheek  Form”  for  the  TB-24  developed  by  Lt. 
Col.  L.  II.  Ware,  AAF  School  of  Applied  Tactics,  Orlando,  Fla.  The 
second  scalo  is  the41  Preliminary  Form  of  Objective  Scale  of  Instrument 
Flying  Skill  in  tho  TB-17,”  devised  by  the  psychological  group  in  the 
Research  Section,  Medical  Division,  Hq.f  3rd  Air  Force.  The  first 
of  theso  two  scales  consisted  of  15  maneuvers:  10  basic  instrument  and 
5  radio  with  a  total  of  76  measures.  A  sample  item,  instrument  take* 
off,  is  presented  to  illustruto  the  form  of  the  first  of  these  two  scales. 
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Instrument  Take-Off 
2— Gyro  within  2°  runway  heading 
1— Wings  level 

1 — Climb  J50  IAS,  minimum 
1— Gear  up,  flaps  up  at  proper  time 


5 — Total  for  maneuver 


Scoring  is  accomplished  by  checking  the  appropriate  box  when  per¬ 
formance  was  satisfactory.  This  score  is  indicated  beside  tho  boxes. 
A  minimum  grado  of  GO  out  of  a  possible  grado  of  100  is  required  for 
passing  this  scalo.  This  scoring  was  based  on  tho  judgment  of  experi¬ 
enced  pilots;  no  reliability  or  validity  data  were  collected. 

Tho  Third  Air  Force  instrument  scalo  includes  42  measures— 24 
being  objective  and  18  rated  work  samples.  These  items  involve  tho. 
following  seven  maneuvers: 


1.  Instrument  taktsoff. 

2.  Spiral  climb. 

3.  Level  flight. 

4.  90°  and  180°  turns. 


5.  Steep  bank. 

6.  Stalls. 

7.  Glides. 


This  scale  was  administered  to  48  experienced  four-engine  pilots 
(including  25  instrument  instructors  and  check  pilots)  and  20  four- 
engine  student  officers.  Tho  biscrial  correlation  of  the  total  score 
against  these  two  groups  differing  in  experience  was  0,20.  No  reli¬ 
ability  data  were  reported  in  this  preliminary,  study. 

Items  for  the  Final  TB-24  Instrument  Scale  M 

Measures  previously  developed  by  tho  Pilot  Project  and  other 
groups  were  tailored  specifically  for  a  final  TB-24  instrument  check 
rido.  On  tho  first  page  of  tho  booklet,  the  student  was  given  instruc¬ 
tions  as  to  how  he  could  mako  his  best  score  by  defining  tho  passing 
and  failing  limits  for  altitude,  heading,  and  air-speed  deviations. 

Appendix  tables  A8.9  and  A8.10  present  an  inventory  of  tho  ma¬ 
neuvers  included  in  the  scale  and  two  samplo  complete  maneuvers. 

A  B-29  Scale 

The  importance  of  instrument  skill  in  flying  tho  TB-29  suggested 
that  research  be  initiated  in  tho  instrument  phase,  for  even  under 
contact  conditions  tho  B-29  pilot  flies  with  frequent  reference  to  hit 
instruments. 

At  tho  time  the  war  ended  only  a  few  measures  specifically  designed 
for  tho  TB-29  had  been  constructed.  However,  it  was  expected  that 
most  of  tho  TB-24  measures  could  bo  easily  modified  to  fit  this  larger 
plane. 

*  Lt  Q.  n.  n*f7  M»l*tod  la  Um  preparation  of  thl*  tool*. 
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OTHER  RESEARCH  ON  INSTRUMENT  FLYING  SKILL 

i 

Exploration  of  Specially  Designed  Apparatus 

The  Psychological  Research  Project  (Pilot)  purposefully  limited  ! 
its  work  in  objective  scale  development  to  the  use  of  the  instruments,  ' 
equipment,  and  facilities  normally  found  in  training  aircraft.  How¬ 
ever,  some  preliminary  work  was  done  exploring  the  possible  use  of 
two  specially  designed  devices  which  might  be  used  in  evaluating 
instruincnt-flying  proficiency.,  ,  I 

Use  oj  the  work-adder  in  measuring  flying  technique. — A  consistent  1 
and  frequently  repeated  criticism  by  pilots  of  many  objective  meas¬ 
ures  of  flying  skill  refers  to  the  omission  of  adequate  measures  of  ' 
technique.  Most  objective  measures  were  taken  from  the  end  prod-  * 
uct  of  pilot  performance  with  no  evaluation  of  how  these  results  were 
obtained.  Flying  instructors  generally  emphasized  technique  and  ; 
judgment  equally  with,  if  not  more  than,  precision  limits  of  the  plane 
in  flight.  In  the  absence  of  any  adequate  objective  measure  of  tech¬ 
nique  the  assumption  was  made  that  when  testing  groups  of  students, 
those  with  superior  technique  could  maintain  tighter  limits  than 
students  with  poor  technique.  Such  an  assumption  is  less  tenable  a 
when  evaluating  the  individual  student. 

Ono  common  error  ascribed  to  poor  technique  is  excessive  use  of 
controls,  o.  g.,  rudder,  aileron,  elevator,  etc.  Although  the  student  j 
achioves  the  desired  control  of  heading,  altitude,  air  speed,  etc.,  he 
has  to  work  too  hard,  wasting  energy  and  gasoline  by  ovcrcontrolUng. 
The  work-adder  principle  was  applied  directly  to  this  problem  yield-  j 
ing  an  objective  record  of  tho  number  and  extent  of  control  move-  * 
ments  made.  A  more  complicated  device  could  probably  bo  devised 
to  mcasuro  pressures.  In  cooperation  with  Dr.  Roger  B.  Loucks,  • 
Department  of  Psychology,  AAF  School  of  Aviation  Medicine,  an  * 
experimental  model  of  a  work-adder  counter  was  developed  and  ! 
given  preliminary  try-outs  in  actual  flight  (TB-25).  The  attach¬ 
ment  was  made  to  the  rudder  cable  in  a  manner  that  in  no  way  > 
affected  tho  control  of  the  piano  in  flight.  Such  a  device  could  easily  | 
bo  attached  to  tho  aileron  and  elevator  cables  and  to  the  throttle. 
Tho  professional  judgment  of  expert  pilots  was  that  this  apparatus  j 
would  bo  useful,  particularly  in  evaluating  instrument  and  formation 
flyiog. 

For  the  purposo  of  exploring  its  use  os  a  possible  mcasuro  of  instru¬ 
ment-flying  proficiency,  ono  model  of  the  work-odder  counter  was  i 
installed  in  ono  of  tho  instrument  planes  at  Pampa  Army  Air  Field  j 
to  bo  used  at  tho  timo  of  tho  final  instrument  check  rides  reported  ; 
earlier  in  this  chapter.  A  rudder  action  count  was  mado  for  sc  von  > 
students  on  tho  basic  maneuvers  included  on  tho  final  chcck-nde 
booklet.  Tablo  8.12  gives  tho  distribution  of  rudder-action  counts 
for  tho  7  students  tested  and  for  the  10  basic  instrument  maneuvers. 
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Table  8.12. — Average  rudder  action  counie  made  by  eeven  etudtnte  on  ten  baoto 

inetrumet.  tnaneuvert 


Maneuver 

Avenqre 

rudder 

count 

Maneuver 

Arerac* 

rudder 

count 

1.  Instrument  teke-off . 

17.2 

2.0 

1.* 

1.7 

8.9 

1,  Steen  turn  .  ..... 

LI 

14.  • 

LI 

t* 

7.0 

j  Spiral  climb..  . . 

7.  Sinflft-tnc’lna  procedure . T , . 

i.  Level-out,  partial  panel . 

4.  180*  full  panel  turn  . 

1.  Power  off  ft  all . 

9.  Divine inlrml . *  .... 

y  l'artlal  panel  180*  turn . 

10.  Spiral  climb,  partial  panel . . . 

Average  Accumulated  rudder  cociiti  for  the  aeven  ttudonU:  1.7,  4.0,  1.2,  M,  7.2, 74,  IMk 


The  results  in  table  8.12  reflect  ono  of  the  flight  characteristics  of  the 
TB-25  which  is  not  a  “rudder  plane/'  i.  o.,  coordintcd  turns  can  be 
mado  with  vciy  little  uso  of  tho  rudder.  It  is  interesting  to  note  that 
moro  than  twice  as  much  rudder  was  used  when  making  turns  or 
climbing  without  tho  uso  of  the  directional  gyro  and  tho  flight  indi¬ 
cator  than  when  tho  full  instrument  panel  was  available  to  tho  student. 
This  shows  that  tho  work-adder  is  sufficiently  sensitive  to  discriminate 
at  least  ono  aspect  of  technique  in  maneuvers  of  varying  difficulty. 

A  moro  crucial  test  of  this  apparatus  could  bo  mado  by  using  it 
during  formation  flying  since  amount  of  rudder  “work”  is  ono  of  the 
chief  distinguishing  characteristics  of  good  and  poor  formation  flying 
skill. 

Tho  apparatus  worked  very  well.  It  was  of  simple  construction, 
could  be  quickly  installed,  easily  read  by  tho  check  pilot,  and  provided 
an  accurate  count  of  any  rudder  movement  ns  great  as  ono-half  inch. 

Radio  beam  tracker.— A.  radio  beam  tracker  was  developed  by  Dr. 
Loucks,  Department  of  Psychology,  AAF  School  of  Aviation  Medi¬ 
cine,  which  recorded  tho  flight  path  of  an  aircraft  flying  tho  radio 
rango.  This  is  an  adaptation  of  tho  Link  “crab”  but  was  a  compli¬ 
cated  picco  of  apparatus  and  as  such  would  not  bo  suitablo  for  largo- 
scalo  uso  in  tho  immediate  future.  However,  tho  problem  which  it 
was  designed  to  answer  was  crucial  and  its  final  development  would 
bo  a  distinct  asset  in  objectively  grading  pilots'  radio  rango  flying 
proficiency. 

SUMMARY 

Instrument  flying  skill  was  of  great  importance  in  military  avia¬ 
tion.  Throughout  tho  courso  of  tho  war  increasing  emphasis  was 
placed  on  instrument  training  including  a  greater  stress  on  objective 
limits  as  a  part  of  tho  final  instrument  check  (AAF  50-3  “white  card”) 
required  of  all  graduating  pilots.  Bccnuso  of  its  importanco  and  its 
adaptability  to  objective  measurement,  tho  Pilot  Project  placed  a 
high  priority  on  research  in  developing  objective  measures  of  instru¬ 
ment  flying  skill. 

Tho  completed  studies  in  tho  instrument  area  can  bo  summarized 
in  four  stages:  (1)  A  “shotgun”  administration  of  both  contact  and 
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instrument  measures  to  largo  groups  of  students  to  determine  the 
best  area  of  concentration;  (2)  a  methodological  analysis  to  determine 
the  most  effective  way  of  scoring  instrument  measures;  (3)  actual 
constructio  of  comprehensive  objective  check  rides  and  administra-  ! 
tion  to  students  for  purposes  of  statistical  analysis;  and  (4)  construc¬ 
tion  of  a  large  inventory  of  objective  instrument  measures  for  use  in  r 
several  different  stages  of  training.  The  work  was  initiated  ia  the  i 
two-engine  area  with  the  TB-25. 

Tho  first  experimental  use  of  instrument  measures  was  made  at  the 
end  of  an  extra  5  weeks’  training  period  given  to  all  upper-class  students 
in  the  Advanced  two-engine  schools  (see  chapter  10).  The  results 
showed  a  significant  improvement  in  precision  instrument  flying  with 
tho  additional  training.  The  results  also  indicated  that  much  greater 
proficiency  was  attained  when  the  additional  training  was  given  in  the  ; 
samo  typo  plane  than  when  students  were  transferred  from  one  type  j 
to  another.  It  was  concluded  that  pilots  must  be  thoroughly  familiar 
with  tho  flying  characteristics  of  tho  TB-25  beforo  precision  instru-  1 
ment  flying  is  possiblo  in  this  plane. 

Threo  different  methods  of  scoring  instrument  measures  were  com¬ 
pared.  These  wero  tho  range,  tho  limits,  and  the  time  sample  method. 
Three  samplo  measures  (altitude  in  instrument  steep  turn  and  heading 
and  altitude  in  instrument  straight-and-levcl)  were  scored  by  each  of  j 
the  threo  methods.  Reasonably  satisfactory  results  wero  secured  by 
all  threo  methods.  For  tho  three  sample  measures  scored  in  the  threo 
different  ways,  tho  observer  reliabilities  ranged  from  0.54  to  0.90,  the 
reliabilities  of  test  and  retest  in  immediate  succession  from  0.37  to 
0.82,  and  the  correlations  with  instructor’s  ratings  from  0.15  to  0.33.  j 
Although  tho  time  samplo  method  had  tho  highest  observer  reliabil¬ 
ities,  its  test-rctest  reliabilities  and  validities  wero  no  better  than  those 
of  the  range  method.  Tho  rango  appeared  to  be  somowhat  better  than  j 
the  limits  method.  In  general  thero  were  no  great  differences  among 
tho  three  methods.  | 

A  34-item  objective  check  ride  was  developed  and  administered  on 
6  instructor-student  dual  instrument  flights.  Tho  odd  versus  oven 
day  reliabilities  for  the  measures  showed  that  thero  was  a  great  deal 
of  day-to-day  variability.  Tho  coefficients  ranged  from  —0.21  to 
0.64,  with  a  median  of  0.25.  For  the  22  most  reliable  measures,  the 
differences  between  scores  aftor  2  and  after  6  dual  instrument 
flights  wero  computed.  Thirteen  of  tho  twenty-two  measures  yielded 
differences  which  wero  significant  at  tho  1  percent  level  or  above. 

This  indicates  that  they  were  valid  for  tho  purpose  of  discriminating 
between  students  with  different  amounts  of  training. 

A  second  and  longer  check  rido  of  70  items  was  constructed  for  use 
as  a  final  check  at  the  end  of  the  instrument  training  poriod.  It  was 
found  that  the  students  who  were  given  the  daily  check  made  some¬ 
what  better  objective  scores  at  tho  end  of  instrument  training  than  • 
'  ♦ 
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thoso  who  wcro  not  given  this  test  on  each  dual  ride.  After  &  4-wcok 
interval  of  further  contact  and  transition  flying,  the  long  instrument 
cheek  was  given  again.  No  consistent  change  occurred  in  tho  lovel  of 
instrument-flying  proficiency. 

A  recommended  final  instrument  check  ride  is  presented  as  a  somplo 
of  the  typo  of  standardized  flight  check  which  could  bo  used  to  eval¬ 
uate  instrument-flying  skill.  Preliminary  work  was  done  at  tho  four- 
engine  level  of  training  and  samplo  objective  instrument  measures 
aro  briefly  described. 

Tho  use  of  objective  measures  at  the  Basic  lovel  in  the  single-engino 
AT-6  is  presented  in  tho  following  chaptor. 
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CHAPTER  NINE. 


Objective  Measures  of  Single- 
Engine  Instrument  Flying 
Skill  at  the  Basic  Level  of 
Flying  Training 

Capt.  William  V.  Hagin 41 


INTRODUCTION 

As  was  explained  in  tbe  previous  chapter,  most  of  tho  work  of  the 
Pilot  Project  on  developing  objective  measures  of  flying  skill  beyond 
the  Primary  phaso  was  concerned  with  instrument  flying  skill,  since 
instrument  flying  was  so  important  for  military  operations  and  was 
also  ^specially  adapted  to  objective  measurement. 

In  tho  basic  phase  of  flying  training,  the  students  learned  how  to 
control  the  airplane  using  only  cues  from  tho  instrument  panel  as  a 
guido  to  tho  flight  attitude  of  the  aircraft.  A  cloth  hood  was  put 
over  tho  cockpit  to  simulate  conditions  under  which  tho  pilot  could 
not  see  the  horizon  or  other  natural  points  of  rcfcrcnco.  After  the 
student  had  learned  these  fundamental  elements  of  instrument  flying 
skill  at  basic  school,  he  graduated  to  advanced  whero  ho  learned  to  use 
the  additional  cues  supplied  by  radio  and  to  apply  tho  various  elements 
of  instrument  skill  to  practical  problems  such  ns  flying  cross  country 
and  making  instrument  let-downs.  Tho  nature  of  instrument  flying 
is  described  in  detail  in  Chapter  3,  An  Analysis  of  tho  Pilot's  Task. 

It  was  important  to  develop  a  scolo  for  measuring  objectively 
instrument  ilying  skill  in  tho  AT-6  (North  American* 'Texan”)  since 
all  students,  both  tho  prospective  two-engine  and  single-engine  pilots, 
learned  tho  samo  elements  of  instrument  Hying  skill  in  that  eircraft 
during  their  Basic  training. 

PURPOSE  AND  PROCEDURES 

Purpose 

This  study  was  initiated  to  develop  and  evaluate  an  objective 
scalo  for  measuring  instrument  flying  proficiency  in  tho  AT-0  at  the 
Basic  level  of  training.  Tho  specific  sub-goals  were: 

(1)  to  construct  a  comprehensive  battery  of  items  for  objectively  . 
measuring  instrument  flying  skill; 

•  8/8ft  Walter  W.  lunar)  assisted  In  tho  construction  end  administration  of  thl*  oealo.  Tbo  statistical 
analyst*  was  planocd  with  tbo  assistance  of  8/F|t.  Ismael,  T/Bft.  William  O.Matbroy,  and  f*t.  foha  O. 
Qloasoa. 
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(2)  to  evaluate  each  of  these  items  by  (a)  exploratory  try-out  and 

expert  criticism,  (b)  determining  the  test-retest  reliability  of 
each  item,  and  (c)  determining  the  validity  of  each  item  as  in¬ 
dicated  by  its  correlation  with  the  instructor’s  over-all  rating 
of  instrument  flying  skill; 

(3)  to  compare  tho  reliability  and  validity  of  various  methods  of 

combining  tho  scores  of  individual  items  into  over-all  scores  for 
tho  maneuver  involved; 

(4)  to  compnro  tho  reliabilities  of  itoms  and  of  maneuver  scores  when 

test  and  retest  occurred  within  tho  same  rido  with  thoso  when 
test  and  retest  wero  given  on  different  days;  and 

(5)  to  evaluate  tho  total  score  obtained  from  all  of  the  items  in  the 

scalo  by  determining  (a)  the  split-half  reliability  of  that  score, 
(b)  tho  reliability  of  test  and  retest  on  different  days,  and  (c) 
tho  validity  of  the  total  scoro  as  indicated  by  its  correlation 
with  instructor’s  rating. 

Developmental  Procedures 

First,  a  preliminary  85-item  scale  was  constructed  and  adminis¬ 
tered  to  20  studonts  in  Basic  flying  training.  After  testing,  the  in¬ 
structors  and  students  were  interviewed  with  reference  to  the  fol¬ 
lowing  points: 

(1)  Adequacy  of  tho  measures; 

(2)  Suggested  revisions  and  additions  to  tho  scalo;  and 

(3)  Elimination  of  items  which  might  contributo  to  an  acci¬ 

dent. 

This  protest  was  an  oxtrcmcly  important  step  in  developing  flying 
scales  sinco  many  test  items  that  appeared  safe,  sensible,  and  adequate 
on  tho  ground  wero  not  suited  to  the  actual  flying  situation.  Though 
tho  groups  tested  were  not  largo  enough  for  extensive  statistical 
analysis,  tho  information  gained  was  of  value  in  constructing  the  final 
form  of  the  scalo  and  holped  to  establish  rapport  with  school  personnel 
through  participation  of  instructors  and  supervisors  in  tho  construc¬ 
tion  of  tho  scalo  thoy  wero  to  work  with  in  .the  moro  extensive  study. 

Description  of  the  Cheek-Ride  Booklet 

Tho  final  form  of  tho  test  booklot  is  reproduced  in  appendix  A.9 
(pages  433  to  441).  It  wa9  printed  on  lightweight  card  stock. 
Tho  ontiro  first  pago  was  devoted  to  biographical  information,  general 
instructions  to  tho  students  and  check  pilots,  and  tables  showing 
tho  weights  for  deviations  in  heading,  air  speed,  altitude,  and  time. 
Theso  weights  wero  derived  from  frequency  distributions  of  the 
raw  scores  obtained  on  tho  preliminary  administration.  The  class 
intervals  wero  chosen  to  achiovo  good  distributions  and  wero  weighted 


so  as  to  approximate  standard  scores  for  deviations  in  heading, 
altitude,  air  speed,  etc.  Thus  a  score  of  (5)  on  headings  was  roughly 
equivalent  to  a  score  of  (5)  for  any  of  the  other  variables.  Point 
scores  for  the  “Yes  or  No”  type  of  item  used  for  tho  instrument 
take-off  were  included  with  the  item.  Tho  four  Unusual  Position 
Recovery  measures  were  graded  subjectively  on  a  four-point  multiplo- 
choice  scalo  printed  opposite  each  of  those  maneuvers. 

In  all  there  were  20  maneuvers  in  tho  scalo  and  a  total  of  81  items. 
Tho  time  required  for  administration  was  slightly  over  one  hour. 

Specific  instructions  to  the  check  pilot  wero  included  with  each 
maneuver;  instructions  to  be  given  to  tho  student  were  standardized 
by  having  the  check  pilot  read  them  from  the  booklet. 

The  check  pilot  recorded  tho  students'  deviations  on  the  scorecard 
dials  using  tho  markings  shown  in  the  sample  below; 


(B) 


The  starting  point  for  each  maneuver  was  marked  with  (A)  and 
the  deviations  were  marked  with  the  curved  lines  (B).  Tho  devia¬ 
tions  wero  marked  continuously;  tho  check  pilot  made  now  marks 
each  time  tho  students  exceeded  previous  errors.  Thus  by  subtract¬ 
ing  tho  lowest  figure  reached  from  tho  highest,  tho  student’s  range 
during  tho  maneuver  was  easily  obtained. 

Administration  of  the  Test 

The  final  form  was  administered  to  class  45-G  at  Moore  Army  Air 
Field  Basic  Flying  School  during  tho  period  30  August  to  2  September 
1945.  All  students  had  finished  their  Basic  training  in  tho  AT-6 
except  for  their  final  instrument  chock. 

Sixty  students  were  given  two  rides  on  successive  days  by  different 
check  pilots.  Forty  additional  students  wero  tested  on  ono  rido  only 
during  the  second  day  of  testing.  Local  conditions  wero  such  that  it 
was  impossible  to  schedulo  this  group  for  both  rides.  Tho  first  ad¬ 
ministration  of  tho  test  was  made  during  tho  afternoon  flying  period, 
and  tho  second  on  the  following  morning.  No  student  was  checked 
by  his  regular  instructor. 

Prior  to  actual  test  administration,  each  instructor  rated  hi* 
students’  instrument  flying  ability  on  a  four-group  scale,  using  tha 
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best  25  percent  of  all  the  students  he  over  had,  the  second  25  percent,  , 
tho  third,  and  the  poorest  25  percent  as  standards  of  comparison. 
This  type  of  rating  was  used  to  force  the  instructors  to  make  their 
evaluations  thoughtfully  and  accurately.  Howover,  sinco  only  1 1  of 
tho  05  students  tested  were  rated  in  the  upper  group  and  only  15  in 
tho  lower,  it  was  necessary  later  to. combine  the  two  upper  and  the 
two  lower  groups  into  a  dichotomy. 

Each  student  was  allowed  to  study  the  booklets  before  the  flight.  ! 
He  was  shown  the  weig  its  of  the  items  and  was  told  how  to  make  the 
best  score.  All  students  and  instructors  were  briefed  on  the  items  1 
and  a  general  discussion  of  the  scale  was  held  in  order  to  insure  that 
they  were  thoroughly  familiar  with  how  to  perform  the  maneuvers 
and  how  to  score  the  booklets. 

Scoring  of  Test  I 

After  tho  test  had  been  administered,  raw  test  scores  (range  of 
deviations  in  altitude,  heading,  etc.)  were  converted  to  coded  scores 
using  tho  table  printed  on  the  front  of  the  test  booklet.  These  coded 
scores  served  as  the  basic  data  for  all  analyses.  A  sample  of  the 
scoring  key  for  deviations  in  beading  follows: 


Deviation . 0*  to  6*  8*  to  10*  11*  to  15*  16*  to  20*  Over 

Coded  score .  S  4  12  1 


It  can  bo  seen  that  if  tho  range  of  heading  deviations  was  12°,  the 
student  would  got  a  coded  score  of  3. 

Statistical  Analysis 

Tho  following  statistical  analyses  of  tho  data  were  made: 

1.  Tho  reliability  was  determined  for  each  item  when  test  and 
retest  wero  on  different  days  by  different  check  pilots. 

2.  Tho  validity  of  each  item  was  obtained  by  correlating  item 

scores  with  tho  instructors'  ratings  of  student  performance.  i 

3.  Tho  reliabilities  and  validities  of  three  different  methods  of 
combining  scores  from  individual  items  into  ovor-all  manouvor  scores 
wero  compared.  Tlireo  representative  maneuvers  were  selected  for 
this  analysis. 

4.  Tho  reliabilities  of  representative  items  and  maneuvers  when 
test  and  retest  occurred  within  tho  same  ride  wero  compared  with 
thoso  obtained  when  test  and  retest  occurred  on  different  rides. 

5.  Tho  total  scoro  of  tho  scalo,  based  on  the  5  subjective  and  76 
objectivo  items,  was  evaluated  by  determining: 

•a.  Tho  split-half  reliability  of  tho  total  score  on  each  adminis* 

,  tration. 

b.  Tho  reliability  of  test  and  retest  on  different  days. 

e.  Tho  validity  of  tho  total  scoro  as  indicated  by  its  correlation 
with  instructor’s  rating. 
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RESULTS 


Item  Analysis 

Tho  reliabilities  and  validities  of  tlio  items  aro  summarized  in 
table  9.1.  Tho  day-to-day  reliabilities  were  obtained  by  correlating 
scores  from  rides  given  on  two  different  days  by  two  different  check 
pilots.  Tho  validity  coefficients  presented  wero  correlations  of  item 
scores  from  tho  second  day's  rldo  with  subjective  ratings  by  tho 
students*  regular  instructors.  Tho  second  day’s  booklets  were 
selected  for  validity  analysis  bccauso  100  students  wero  tested  on 
that  day  while  only  60  were  tested  on  tho  first  day. 


Table  0.1. — Summary  of  item  reliabilities  and  validities  for  AT-8  instrument  seals 


Kind  of  measure# 

Number 
in  teal* 

Day-to-day  test -re- 
test  reliability  • 

Validity* 

Beyond 

1  percent 
level 

El  i 

■rrirlB 

mu 

HH 

B33 

•  percent 
level  to 

1  percent 

level 

Altitude . 

Airspeed . 

UtMlni . 

Ancle  of  bank  . 

Subjective  ratlnp . 

Total . 

H 

n 

!§ 

7  M 

S  IS 

1  • 

•  0 

1  4 

3  11 
»  • 

•  0 

■sS 

•  M 

3  IS 
3  IS 
1  30 

s 

M  IT 

7  t 

31  33 

1  Based  on  CO  students  tested  on  different  days,  In  different  planes,  by  different  cheek  pilots. 

•  Correlations  o(  performance  with  ratines  which  were  made  by  the  student’s  secular  Instructor  under 
controlled  conditions  which  assured  complete  Independence  of  validity  criteria  and  dwelt -ride  measures. 
Ninety-Ova  atudents  wera  used  In  validity  analysis. 

Tho  reliabilities  ranged  from  —0.32  to  0.40  and  tho  validities  from 
—0.24  to  0.41.  However,  21  of  tho  81  measures,  or  20  percent  of  them 
wero  reliable  at  tho  5  percent  level  of  significunco  or  better;  28,  or  35 
percent,  wero  valid  at  tho  snmo  level  of  significance.  Altitude  and 
nirrpeed  measures  were  tho  most  rcliablo.  Although  only  9  of  tho  81 
items  wero  both  significantly  rcliablo  and  valid,  tho  correlation  bo- 
tween  tho  reliabilities  and  validities  of  all  test  items  was  0.34  (signifi¬ 
cant  at  tho  1  percent  level  or  above)  indicating  that  tho  moro  rcliablo 
items  also  tended  to  bo  somewhat  moro  valid. 

Fivo  of  tho  measures  in  tho  scalo  wero  subjective  ratings  by  tho  check 
pilot.  Nono  of  these  items  yielded  statistically  significant  reliabilities. 
Only  one,  "Instructor  Help  on  Take-off,*’  was  significantly  valid  at 
tho  5  percent  level  or  above.  Tho  reliability  and  validity,  respec¬ 
tively,  of  each  mcasuro  is  presented  in  tables  A9.1  and  A9.2  of  tho 
appendix  to  this  chapter. 

Comparison  of  Three  Methods  of  Combining  Items  into  Maneuver  Score* 

Each  item  was  &  single  mcasuro  (Heading,  Altitude,  etc.)  taken 
during  tho  performance  of  a  maneuver  such  as  climb,  turn,  or  lovol 
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Table  9.4.—  Companion  of  rrliabilitiee  when  test  and  reteit  occur  on  the  tame  check 
ride  with  thoee  when  test  and  reteit  occur  on  different  dayt 

Altitude  Measure*  in  Turns  and  Legs  of  Pattern  A 


Flint  leg  Terms  second  leg; 

Sam*  rid*. . 

Different  days . 

Second  let  versus  third  Itf: 

Sam*  rid*  . 

Different  days...... . 

Third  left  versus  fourth  ltf : 

Same  rid*  . 

Different  <1  tys  . 

First  turn  versus  second  turn 

Sam*  rid* . 

Different  dAjrs . 

Second  turn  versus  third  turn 

Fame  rid* . 

Different  day*  . 

Third  turn  versus  fourth  turn 

Fame  rid* . 

Different  day*  . 

Mean  (t  combination): 

6am*  rid*  . 

Different  days . 


Mi 

Mi 

LM 

171 

197 

4.21 

tit 

147 

til 

4.14 

til 

144 

til 

4.07 

IIS 

110 

a.  47 

1M 

130 

111 

1.30 

04 

117 

115 

115 

4.11 

Maneuver  Scores  In  Turns  of  Pattern  A 


Scoring  M*thsd 

B*U  weight: 

Fame  rid* . 

Different  day* . . 

Equal  weight: 

Fame  rid* . 

Different  days . 

"E  inert  pilot"  weight: 

Pam*  rid* . 

Different  days . 


H71 

17.47 

iioa 

40.  68 

4151 

mi 

10  37 

10  09 

101 

10.50 

11.84 

171 

m 

150 

109 

103 

104 

100 

Evaluation  of  the  Total  Score 

Tho  coded  scores  on  nil  of  tho  items  in  tho  scnlo  were  summed  to 
givo  three  scores  for  analysis:  odd  half,  even  half,  and  total  score. 
The  scalo  was  divided  so  that  tho  two  halves  were  equated  with  tho 
samo  number  of  similar  measures  in  each  half.  This  was  done  for 
both  administrations  of  tho  test.  Thus  it  was  possiblo  to  obtain 
split-half  reliability  for  both  rides  as  well  os  tcst-rctcst  reliability  of 
tho  total  scnlo  when  tho  rides  were  administered  on  different  days  by 
different  check  pilots. 

Tho  reliability  data  in  table  0.5  show  that  tho  internal  consistency 
(split-half  reliability)  of  tho  scnlo  was  0.89  which  is  high  and  com¬ 
pares  favorably  with  that  of  written  tests.  Tho  tcst-rctcst  reliability 
on  difforent  tL*vvs  was  0.46  and  significantly  higher  than  that  of  any 
of  tho  items. 

Similarly,  tho  validity  coefficients  in  table  0.5  were  all  significant  at 
bottor  than  tho  1 -percent  level  and  woro  larger  than  thoso  from  any 
ainglo  item  in  tho  scalo.  Tho  correlation  of  tho  combination  of  the 
two  administrations  with  instructor’s  ratings  was  0.51.  This  is  high 
in  viow  of  tho  probablo  unreliability  of  tho  latter  criterion. 


Table  9.5. — Reliabilitie*  and  validUitt  of  total  teore  derived  from  81  meaturet  in 

ATS  teal* 

(Dased  on  68  studanta  from  data  48-OJ 

A.  RellabUitleo 


r'tf 

'if 

Aft 

Mt 

an , 

SOi 

1  First  hnlf 1  rerri/rweond  half  *  first  administration  .. 

0.83 

a  91 

131.41 

143  21 

Ml  13 

31.03 

2.  First  half >  etttut  second  half*  second  adinlnlitre. 
lion . . . 

.80 

.89 

163.38 

154.86 

1130 

17.17 

3.  Total  score  *,  test  itrtut  retest . 

.46 

290.  71 

321.96 

33.40 

28.93 

D.  Validities 


n 

A/. 

.V, 

4.  Total  score  first  administration . 

0.44 

a  49 

311.33 

28168 

3140 

i^nngMEf  if  nhiiHTli.  *11  HWiUmHiWIP 

.40 

.49 

331.41 

81188 

38.88 

6.  ToIjI  score  first  ednilnlstration+seoood  ad  min  la- 

trafion . 

.11 

.49 

64174 

865.64 

17.  M 

i'll  Correlation  between  two  halve*. 

r,i  Correlation  corrected  to  estimate  reliability  of  total  cheek  ride  for  1  and  %  and  test-retest  reliability 
of  total  cheek  ride  for  3. 

•  First  half  Is  total  of  scores  3.  4.  A.  7,  S. ».  14.  IS,  17,  IS,  22,  23, 74,  2ft,  X.  77,  28,  79, 30, 31, 32, 33, 44,  47,  41,  4S, 
JO.  SI,  S3,  M.  M.  11.  S f>.  ft 7,  88.  0-1,  0-3,  71.  75,  77,  and  7S. 

•  Second  hnlf  is  total  of  scores  ft.  10,  1 1,  12.  13.  15.  IS.  20.  21.  34,  35,  34, 37,  38.  39,  40,  41,  42,  43.  44,  43,  80.  09, 
Cl.  r>2. 03. 04.  Oft.  00. 07.  M,  r,a.  ;o.  U-3,  O-t,  72. 73,  76,  79,  and  80. 

•  Total  score  U  total  of  first  plus  second  halves  as  defined  above. 

SUMMARY  AND  CONCLUSIONS 

1 

Instrument  (lying  was  a  most  important  aspect  of  flying  skill  dur¬ 
ing  tlio  wur  years.  Every  pilot  had  to  be  competent  at  instrument 
flying  since  combat  operations  were  conducted  despito  bad  weather. 
Tlio  importance  of  good  instrument  pilots  and  tho  adaptability  of 
instrument  flying  to  objective  measures  inndo  it  dcsirablo  to  con¬ 
centrate  research  in  this  area. 

An  Sl-item  scale  for  measuring  instrument  flying  proficiency  at 
tho  Basic  level  of  training  was  constructed  and  administered  at 
Moore  Army  Air  Forces  Basic  Flying  School  on  2  successive  day*  to 
CO  students  and  to  an  additional  group  of  40  students  on  tho  second 
day  only. 

Although  tho  reliabilities  of  tho  test  items  ranged  from  —0.32  to 
0.40  and  the  validities  ranged  from  —0.24  to  0.41,  20  percent  of  the 
reliabilities  and  35  percent  of  tho  validities  were  statistically  significant 
at  tho  5  percent  level  or  better. 

Of  tho  five  subjective  measures  in  tho  scale,  nono  had  a  statistically 
significant  reliability  and  only  one  had  a  significant  validity. 

A  comparison  was  made  of  tlirco  different  mothods  of  combining 
tho  scores  on  individual  items  into  a  score  for  tho  maneuver  involved. 
The  methods  wero  beta  weights,  equal  weights,  and  weights  based  on 
professional  judgment.  This  third  method  approximated  cut-off 
scores.  No  great  differences  wero  found  in  tho  reliabilities  or  validi¬ 
ties  of  these  three  methods.  In  general,  the  maneuver  scores  wers 
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somewhat  moro  reliable  and  valid  than  the  average  of  the  items 
involved  but  poorer  than  the  best  item. 

For  both  items  and  maneuver  scores  the  correlation  between  test 
and  retest  within  the  same  check  ride  was  considerably  higher  than 
that  between  two  tests  on  different  days. 

All  items,  both  tho  5  subjective  and  the  76  objective,  were  com¬ 
bined  (with  equal  weights)  into  a  total  score.  The  odd-even  relia¬ 
bility  (corrected  for  double  length)  of  a  single  chock  ride  was  0.89. 
Tho  correlation  between  check  rides  on  different  days  was  0.46. 
From  this  it  can  bo  estimated  that  the  tcst-rctcst  reliability  of  the 
sum  of  the  scores  on  two  check  rides  would  bo  0.63.  Tho  correlation 
botween  the  sum  of  tho  scores  on  tho  two  rides  and  an  over-all  rating 
of  instrument  flying  proficiency  made  immediately  before  these  rides 
by  the  student’s  instructor  was  0.51.  These  figures  indicato  that  it 
is  fcasiblo  to  develop  a  reliable  and  valid  objective  scale  of  instrument 
flying  skill. 
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CHAPTER  TEN. 


A  Large-Scale  Objective  Study 
of  the  Effects  of  Additional 
Training  on  Flying  Skill" 

Maj.  Neal  E.  Miller,  1st.  Lt.  William  E.  Galt  and 
S/Sgt.  Charles  P.  Gershcnson 


PURPOSE  AND  PROCEDURES 
The  Training  Freeze 

In  the  fall  of  1944  pools  of  surplus  pilots  had  accumulated  in  the 
Training  Command  because  combat  needs  were  not  ns  great  ns  had 
been  anticipated.  In  order  to  eliminate  theso  pools,  Headquarters, 
Army  Air  Forces,  ordered  training  freezes. 

Normally  10  weeks  were  spent  at  each  of  the  threo  levels  of  training: 
Primary,  basic,  and  advanced.  At  any  one  time  there  wero  two  classes 
in  the  school  at  each  level.  The  lower  class  received  its  first  5  weeks 
of  training  while  the  upper  class  received  its  Inst  5  weeks.  At  tho 
end  of  this  period,  the  upper  class  was  graduated  to  tho  next  level  of 
training  and  tho  lower  class  was  promoted  to  upper  class. 

The  first  5-wcck  training  freeze  began  in  the  middle  of  October 
1944.  Instead  of  being  graduated  to  the  next  level  of  training,  the 
upper-class  students  in  Primary,  Basic,  and  Advanced  schools  wero 
held  over  for  an  additional  5  weeks.  During  this  time  the  students 

u  Tho  entire  atafl  of  the  Pilot  Project  hi  cooperatively  Involved  In  this  study,  with  special  assistance 
from  tho  Psychological  Section,  Office  of  the  Surgeon,  Uq.  A  AF  Training  Command.  Maj.  Neal  E.  MUler 
was  responsible  for  over-all  direction  and  for  conducting  conferences  to  arrange  tho  details  of  part  Id  pal  low 
with  schools  In  Central  Flying  Training  Command.  Capt.  Richard  P.  Youts  was  responsible  for  l ha 
development  and  pretesting  of  measures  for  tha  scale  used  In  Primary  and  Advanced  single-engine  school* 
and  for  conferences  to  arrange  for  participation  of  single-engine  schools  In  Western  Flying  Training  Com¬ 
mand.  Maj.  Anthony  C.  Tucker,  assigned  to  temporary  duty  with  tho  Pilot  Project,  was  responsible  for 
developing  and  pretesting  measures  for  the  scale  used  In  BaMe  schools  and  for  conferences  to  arrange  for 
participation  of  tingle-engine  schools  In  Eastern  Flying  Training  Command.  Capt.  8 1  an  ford  C.  Erkksea 
was  responsible  for  developing  and  pretesting  measures  for  the  scale  used  In  Advanced  two-engine  schools 
and  for  the  conference  to  arrange  for  the  participation  of  all  such  schools.  I.t.  William  E.  Oalt  cheeked  os 
ths  Instrument  measures  with  the  standardisation  boards  at  the  Instructors  School  (Instrument  Pilot) 
at  Bryan,  Tei.,  and  visited  schools  In  Eastern  and  Central  Flying  Training  Commswli  to  cheek  up  on  con¬ 
ditions  of  testing.  T/8gt.  W.  O.  Matheny,  8/Hgt.  W.  W.  Ismael,  8/Agt.  I.  Robbins,  Sgt.  J.  R.  Rohr*,  and 
8gt.  M.  F.  Connery  supervised  testing  at  different  flying  schools.  M*J.  Rains  Wallace  was  responsible  fur 
coordinating  directives  In  tha  Training  Command  Headquarters,  arranging  for  ths  printing  of  seals*  and 
directions,  and  receiving  the  rosters  from  the  schools.  I.t.  Col.  Walter  I.,  Deemer  servrd  as  statistical  con¬ 
sultant  and  supervised  the  transferral  of  the  data  to  punch  t-araCs  In  the  Statistical  Unit  of  the  Ps>ehological 
Section.  8,'Fgt.  Charles  P.  Oershenson  supervised  llie  analysts  of  tho  dataon  tabulating  machines.  Ur  waa 
assisted  by  8*t.  J.  W.  Stratton,  i.  I.  Warltermann  and  I.  R.  Rohr*.  Prof.  Phillip  I.  Rulon,  Acting  Doaa 
of  Ibo  Oraduate  School  of  Education,  Harvard  University,  advised  on  the  measures  and  o£  statistical  dsslgs 
as  a  Special  Consultant  to  ths  Secretary  of  War. 
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who  had  been  in  the  upper  class  received  an  additional  training  *  and 
those  who  had  been  in  the  lower  class  went  on  to  receive  the  normal 
upper-class  training.  Thus,  at  the  end  of  the  5-wcek  freeze,  the  stu¬ 
dents  who  had  been  in  the  lower  class  of  Primary,  Basic,  or  Advanced  * 

had  completed  the  normal  10  weeks  of  training  and  those  who  had  ’ 

been  in  the  upper  class  had  received  an  additional  5  weeks,  making  a 
total  of  1 5. 

After  this  first  training  freeze,  the  lower  class  which  had  already 
received  the  normal  upper-class  training,  was  trained  for  an  additional 
5  weeks  and  the  next  class  began  its  initial  5  weeks  of  training.  This 
second  freeze  put  the  two  classes  back  into  phase. 

i 

Purpose  of  the  Study 

Approximately  3  weeks  beforo  the  beginning  of  the  first  training 
freeze,  the  Chief  of  Staff  of  the  Training  Commnnd  asked  the  Pilot 
Project  to  use  this  sudden  opportunity  to  secure  objective  measures 
of  tho  effects  of  the  additional  training.  Specifically  the  purposes  of 
this  study  were: 

1.  To  measure  objectively  the  effects  on  flying  proficiency  of  the 
additional  five  weeks  of  training  at  each  of  the  levels:  Primary,  Basic, 
and  Advanced.44 

2.  To  determine  tho  effects  of  having  received  civilian  flying 
training  before  starting  military  flying  training. 

3.  To  securo  normative  duta  on  the  level  of  skill  of  tho  pilots 
being  trained. 

4.  To  investigate  the  feasibility  of  developing  and  using  objective 
measures  of  flying  skill  in  large-scale  studies. 

Method  Used  in  the  Study 

Decision  to  test  in  many  schools. — It  was  first  necessary  to  decide 
whether  to  plan  an  intensive  or  extensive  study.  Tho  intensive 
approach  would  have  been  to  concentrate  all  of  the  work  in  a  few  ( 
sample  schools,  supervising  these  very  carefully  and  using  a  specially 
trained  endro  of  check  riders  analogous  to  the  Primary  Training 
Advisor}*  Board.  With  the  limited  timo  available  and  tho  small 
staff  of  the  Pilot  Research  Project,  it  would  have  been  possiblo  to 
conduct  intensive  experiments  in  only  one  school  of  each  type: 
Primary,  basic,  advanced  single-engine  and  advanced  two-engine. 

u  In  primary  23,  and  In  all  other  schools  30  hours  of  additional  fly  In*  training. 

M  The  Chief  of  Staff  of  the  Training  Command  was  also  Interested  In  determining  whether  the  In  trod  no¬ 
tion  of  the  additional  5  weeks  of  training  at  one  level  would  produce  more  effect  upon  the  Anal  product 
measured  u!  graduation  from  advanced  training  than  the  Introduction  of  ft  weeks  of  additional  training  at 
other  levels.  Although  It  a  as  believed  that  changes  In  training  conditions  might  make  such  a  comparison 
Impossible,  data  were  collected  on  each  of  the  classes  m  they  graduated  from  advanced  training.  Sines  It 
was  anticipated  that  such  data  would  subsequently  be  collected,  only  hull  of  the  students  were  tested 
during  the  freete  at  each  of  the  levels  of  training  so  that  the  other  half  would  not  have  hod  any  previous 
ei|>rrlrncr  with  such  measures  when  tested  In  advanced.  Random  selection  of  the  students  to  be  tested 
was  Insured  hy  specifying  that  they  he  selected  by  army  serial  number.  Only  those  studrnts  were  tested 
whose  serial  numbers  hiul  the  last  two  digits  In  the  range  00  to  49.  As  hod  been  expected,  training  conditions 
bad  changed  so  much  hy  the  time  that  the  last  students  Involved  In  the  frrrse  (thoss  tested  In  primary) 
graduated  from  advanced,  that  meaning  iuI  longitudinal  comparisons  were  not  possible. 
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Thus,  under  tliis  plan,  any  unusual  circumstance,  such  as  a  continued 
period  of  bad  winter  weather  preventing  flying  at  any  ono  of  the 
selected  schools  during  tho  week  allotted  to  testing,  would  have 
spoiled  tho  experiment. 

Since  it  seemed  desirable  to  include  more  schools  than  could  bo 
tested  by  a  specially  trained  cadre  of  check  riders  personally  super¬ 
vised  by  the  Pilot  Project,  procedures  had  to  bo  designed  so  that  they 
could  be  administered  by  tho  regular  staff  of  any  school  without 
special  training.  Onco  the  procedures  had  been  designed  in  this 
way,  it  was  practically  ns  easy  to  set  up  testing  in  all  tho  schools 
within  the  Training  Command  ns  it  would  have  been  to  concentrate 
on  a  medium-sized  sample.  Therefore,  the  most  extensive  possible 
sample  was  used  in  order  to  bo  sure  to  secure  enough  cases  to  take 
care  of  unforeseen  emergencies  such  ns  weather,  and  to  allow  for 
splitting  the  data  up  into  ns  many  subgroups  ns  might  bo  required 
for  thorough  analysis. 

Procedure  used  in  developing  measures. — At  the  timo  tho  training 
freeze  study  was  assigned,  the  Pilot  Project  was  in  tho  early  stages  of 
developing  objective  measures  of  flying  skill.  Some  measures  had  been 
devised  and  tried  out  on  relatively  small  groups  of  students  in  tho 
primary  and  advanced  two-ongino  phases  of  training.  No  work  hod 
been  done  in  basic  or  advanced  single-engine  schools.  It  was  there¬ 
fore  necessary  to  devoto  considerable  effort  to  the  development  of 
additional  measures. 

The  measures  for  the  different  types  of  training  (primary,  basic, 
advanced  single-engine,  and  advanced  two-engine)  wero  developed  in 
collaboration  with  the  Training  Advisory  Boards  for  those  types  at 
the  Central  Instructors  School  (Pilot).  Tho  Instrument  Board  at 
Central  Instructors  School  (Pilot)  assisted  in  the  development  of  in¬ 
strument  measures.  The  Deputy  for  Training  and  Operations  in¬ 
structed  the  chairman  of  each  board  to  assign  ono  member  whoso 
primary  duty  was  to  cooperate  with  the  Pilot  Project  in  the  training 
freeze  studies.  Tho  other  members  of  boards  also  assisted. 

Since  tho  objective  measures  were  to  be  administered  on  short 
notico  to  largo  numbers  of  students  in  all  of  the  schools  in  the  Training 
Command,  each  individual  item  had  to  bo  simple;  enough  so  that  it 
could  bo  administered  by  the  regular  instructional  staff  without 
special  training  or  complicated  explanations,  and  tho  scalo  os  a  wholo 
had  to  be  short  enough  so  that  it  ''ould  be  fitted  into  tho  regular 
schedule  and  administered  within  a  reasonable  period  of  time. 

Since  the  purpose  of  this  study  was  to  discriminate  between  tho 
performnneo  of  groups  (those  with  10  and  15  weeks  of  training),  it 
W’as  possiblo  to  uso  a  somewhat  shorter  check  ride,  containing  a  less 
comprehensive  sample  of  objective  items  than  would  have  been  neces¬ 
sary  if  it  had  been  desired  to  discriminate  between  individuals.  A 
given  individual  might  score  high  or  low  by  chance;  all  of  tho  mem- 
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bcra  of  a  large  group  of  students,  howover,  would  not  get  high  or  low 
scores  by  chance. 

The  first  step  in  constructing  tho  items  was  to  study  the  curriculum 
prescribed  for  training  during  the  additional  5  weeks  and  to  determine 
what  aspects  of  this  curriculum  could  practically  be  measured  under 
tho  conditions  of  this  experiment.  Items  were  then  constructed, 
criticized,  and  flight-tested  in  collaboration  with  members  of  tho 
Training  Advisory  Boards.  Then  thoso  items  which  seemed  most  * 
promising  were  tried  out  on  groups  of  from  20  to  30  students  in  schools 
at  each  level  in  order  to  determine  the  feasibility  of  tho  item,  the 
proper  ranges  to  be  selected  for  scoring,  and  to  sccuro  criticisms  of  the 
item  from  supervisory  personnel  at  tho  schools.  Tho  schools  selected 
for  pretesting  at  each  lovcl  wero  usually  no  a  Wing  Headquarters  so 
that  tho  criticism  o i  Wing  personnel  could  also  bo  secured.  Further¬ 
more,  instrument  items  wero  taken  to  tho  Instructors  School  (Instru¬ 
ment  Pilot)  at  Bryan,  Tex.,  and  criticized  by  experts  there. 

Some  items  were  found  unsuitable  when  pretested  and  were  elimi¬ 
nated.  Tho  best  items  surviving  pretesting  wero  assembled  into 
chcck-rido  scales  for  each  lovcl  of  flying  training.  Theso  scales 
required  approximately  45  minutes  of  administration  time.  They 
w'erc  printed  on  9  by  12  inch  card  stock  which  could  be  folded  to  make 
check-rido  booklets  stiff  enough  to  afford  good  backing  for  writing 
in  tho  air.  In  all  eases  the  scoring  of  items  was  by  circling  a  number: 

1,  2,  or  3.M 

The  items  used  on  the  ohcck-ridc  cards  for  each  level  of  training 
aro  presented  on  pages  445  through  400  of  tho  appendix.  It  shoulh 
bo  remembered  that  they  were  not  designed  to  discriminate  between 
individuals,  but  only  to  sample  differences  between  groups. 

General  'procedure  followed  in  administering  study. — First,  a  direc¬ 
tive  (letter,  702.5,  Ilq.  AAF  Training  Command,  7  October  1944, 
subject:  Objectivo  Measures  of  Flying  Skill  During  Temporary 
Training  Freezes),  was  indorsed  to  the  schools  by  each  of  the  Flying 
Training  Commands  to  inform  them  of  the  general  nature  of  the 
study  and  tho  necessity  for  their  maximum  cooperation.  Then,  two 
sct3  of  directions  wero  mado  up. 

Ono  sot  of  directions  was  for  tho  administrative  personnel  at  each 
school.  It  described  tho  general  plan  of  tho  study,  when  tho  check 
ride  should  bo  given,  who  should  bo  tested,  who  should  givo  tho  check 
ride,  what  field  preparations  should  bo  mado,  and  tho  procedures  for 
briefing  tho  check  riders  and  tho  students.  Specific  directions  wore 
also  given  concerning  how  tho  scoro  card  should  bo  filled  out,  what 
daily  log  should  be  kept  of  any  special  conditions  that  might  affect 

W  Since  different  types  of  training  planes  had  been  used  at  different  times  In  different  schools  In  tho  Train¬ 
ing  Command,  the  check  ride  for  each  student  contained  a  place  for  recording  tho  types  of  planes  bo  had  boon 
trained  on  In  previous  phases  of  training.  The  number  of  times  which  a  student  had  been  held  orer  after 
graduating  from  prefttght,  his  stanlne,  and  whether  or  not  ho  had  soloed  before  entering  primary  school 
wero  also  recorded. 
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the  results,  and  how  the  school  secretary  should  transcribe  the  scores 
to  the  printed  rosters  which  were  provided. 

The  second  set  of  directions  informed  students  and  instructors  as 
to  the  general  purpose  of  the  study  and  tho  way  each  item  should  bo 
performed  and  scored.  Arrangements  were  made  so  that  a  copy  of 
this  sheet  of  directions  and  a  check-ride  card  would  be  distributed  to 
each  student  before  tho  check  rido.  This  was  dono  so  that  each 
student  would  know  exactly  what  ho  was  expected  to  do  and  how  ho 
would  be  scored  on  it. 

Every  effort  was  made  to  mako  the  two  sets  of  instructions  so  com¬ 
prehensive  and  clear  that  the  whole  procedure  could,  if  necessary,  bo 
run  off  on  the  basis  of  these  instructions  alono.  In  addition,  special 
conferences  were  held  at  tho  headquarters  of  each  of  tho  threo  Flying 
Training  Commands.  Thcso  conferences  were  attended  by  threo  rep¬ 
resentatives  from  each  school:  tho  Commanding  Officer  or  tho  Director 
of  Training,  the  Director  of  Flying,  and  a  member  of  tho  Standardiza¬ 
tion  Board.  Conferences  for  each  type  of  school  were  held  on  separata 
days.  At  theso  conferences  a  representative  of  this  Project  explained 
tho  whole  procedure  in  detail  and  discussed  with  representatives  of  tho 
schools  special  problems  which  might  nriso.  For  two-engino  schools, 
ono  conference  was  held  at  Randolph  Field  instead  of  a  separate  one  in 
each  of  tho  Flying  Training  Commands. 

Finally,  an  effort  was  made  to  visit  as  many  schools  ns  possible 
during  tho  course  of  tho  testing  to  see  how  it  actually  was  accom¬ 
plished.  Those  schools  that  could  not  bo  visited  during  tho  courso  of 
testing  wero  visited  shortly  thereafter.  Key  personnel  were  inter¬ 
viewed  to  determine  how  tho  testing  was  conducted,  what  special  con¬ 
ditions  might  have  influenced  tho  scores,  and  wlmt  criticisms  and 
suggestions  tho  schools  had  to  offer  for  improving  and  adding  to  tho 
objective  measures. 

Specific  conditions  for  administering  check  rides. — Tho  procedures 
which  lmvo  just  been  described  (written  directions,  conferences,  and 
visits  to  schools)  were  all  designed  to  insuro  careful  administration  of 
tho  objcctivo  items  under  standard  conditions.  Tho  most  important 
conditions  of  testing  were  as  follow*: 

1.  All  malo,  white  students  within  tho  specified  ranges  of  army 
serial  numbers  M  wero  tested  with  two  exceptions:  student  officers  and 
students  from  foreign  air  forces. 

2.  All  check  rides  were  flown  during  tho  week  13-18  November 
1944.  This  was  tho  lost  week  of  10  weeks  of  normal  trainiug  for  one 
class,  which  was  called  tho  10-week  group;  it  was  tho  last  of  15  weeks  of 
training  (10  normal  plus  tho  5  additional  weeks  during  tho  freeze)  for 
tho  other  class,  which  was  called  tho  15-week  group. 

3.  Equal  percentages  of  the  10-  and  tho  15-wcek  groups  were  tested 

■  8m  footootM  54  U4  IT. 
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during  any  given  half  day  in  order  to  equalize,  as  far  as  possiblo, 
weather  and  other  conditions  of  testing. 

4.  No  student  was  tested  by  a  check  pilot  from  his  own  squadron. 
The  best  available  check  pilots  were  selected  by  the  supervisory  per¬ 
sonnel  at  each  of  the  schools.  These  check  pilots  flew,  as  nearly  as 
possible,  equal  percentages  of  students  from  the  two  groups. 

5.  The  maneuvers  were  performed  under  as  good  conditions  of 
smooth  air,  visibility,  etc.,  as  possible,  but  climbs  to  excessively  high 
altitudes  to  obtain  smooth  air  were  avoided. 

6.  The  check  pilots  and  administrative  staff  were  told  that  the  rides 
were  for  research  purposes  only,  that  no  student  would  be  eliminated 
from  training  on  the  basis  of  his  performance,  and  that  the  results  of 
nil  schools  would  be  combined  in  the  final  report  so  that  there  would 
be  no  possibility  for  invidious  comparisons. 

Handling  oj  data. — Each  school  transcribed  to  rosters  the  single- 
digit  numbers  which  had  been  encircled  on  the  check-ride  cards. 
Theso  rosters  wero  spot-cheeked  and  all  of  the  data  transferred  to 
punchcards  at  the  Psychological  Section  of  the  Training  Command 
Headquarters.  Then  enlisted  personnel  from  the  Pilot  Project  ana¬ 
lyzed  theso  data  on  tabulators  and  sorters.  First,  distributions  of  all 
the  cards  wero  tabulated  in  order  to  get  a  general  picture  of  tho  data. 
On  tho  basis  of  theso  distributions  it  was  possible  to  decide  which 
groups  should  be  broken  down  for  final  analysis  into  categories  homo¬ 
geneous  enough  for  a  meaningful  interpretation  and  yet  largo  enough 
for  statistical  stability. 

Bccauso  tho  training  freeze  happened  to  coincide  with  a  cliango 
from  lighter  planes  to  the  TB-25  in  tho  advanced  two-engino  schools, 
tho  conditions  for  that  part  of  the  study  wero  different  from  thosoin 
tho  single-engine  schools.  The  further  details  of  analysis  and  tho 
results  will  therefore  be  presented  separately  for  these  two  types  of 
schools. 

EFFECT  OF  ADDITIONAL  TRAINING  ON  SINCLE-ENGINE 

FLYING  PROFICIENCY 


Analysis  of  Data 

Students  included  in  the  final  analysis. — In  order  to  avoid  artifacts 
and  to  make  each  group  more  homogeneous,  certain  students  whoso 
selection  or  training  was  atypical  wero  excluded  from  tho  final  anal¬ 
ysis. 

All  students  who  had  been  held  over  from  one  class  to  tho  next,  for 
sickness  or  other  reasons,  at  any  time  after  preflight  wero  eliminated 
from  tho  study.  Students  wero  excluded  if  they  hod  not  had  all  of 
their  training  for  the  level  at  which  they  wero  tested  in  tho  typo  of 
piano  most  commonly  used:  i.  c.,  Stcammn  for  Primary,  BT-13  or 
BT-15  for  Basic,  and  AT-6  for  Advanced  single-engine.  Since 
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Central  Flying  Training  Command  was  in  tho  process  of  changing  from 
tho  Fairchild  to  Stcarman  at  tho  Primary  level,  this  meant  excluding 
students  from  all  of  tho  schools  in  that  command  from  tho  analysis  of 
tho  Primary  lovcl  of  training.17 

Students  were  also  excluded  if  they  wero  part  of  specially  selected 
groups.  For  tho  analysis  of  tho  advanced  singlo-cngino  lovel  of 
training,  the  students  in  Western  Flying  Training  Command  wero 
excluded  sinco  the  upper  class  was  specially  selected  by  having  poorer 
students  sent  to  another  typo  of  training  instead  of  being  retained  for 
extra  training  during  tho  freeze.  Somo  of  tho  Basic  students  trained 
on  BT  planes  had  to  be  excluded  because  they  wero  tho  poorer  student* 
who  wero  left  over  after  tho  better  ones  in  their  school  had  been 
selected  for  Basic  training  on  tho  AT-6. 

After  the  students  whose  military  flying  training  or  selection  was 
atypical  had  been  sorted  out,  tho  sample  of  singlo-cngino  students  was 
reduced  from  6,438  to  4,757  eases. 

Tho  groups  at  each  level  of  training,  however,  wero  still  not  homo¬ 
geneous.  Somo  of  tho  students  had  received  enough  civilian  flying 
training  to  solo  before  they  entered  Primary  and  commenced  their 
military  flying  training.  Most  of  tho  students  hnd  not  6olocd  before 
entering  Primary.  It  was  therefore  necessary  to  divido  tho  samplo 
into  two  groups:  thoso  who  had  soloed  and  thoso  who  had  not  soloed 
before  entering  Primary.  Sinco  tho  students  who  had  not  solood 
before  entering  Primary  had  received  tho  most  uniform  and  repre¬ 
sentative  training  they  were  tho  samplo  from  which  tho  most  mean¬ 
ingful  conclusions  concerning  tho  effects  of  tho  fivo  weeks  of  additional 
training  during  tho  freezo  could  bo  drawn.  Limiting  conclusions 
concerning  tho  freezo  to  theso  students  reduced  tho  samplo  to  3,833 
singlc-cngino  students. 

Groups  compared  jor  each  level  of  single-engine  training. — After  tho 
6amplo  had  been  refined  by  discarding  atypical  students,  it  was 
divided  into  tho  following  groups  in  order  to  determino  tho  effects  of 
tho  fivo  weeks  of  additional  training  given  during  tho  freezo  and  the 
effects  of  having  had  enough  civilian  flying  training  to  havo  soloed 
before  entering  Primary. 

1.  10-week,  nonsolo  oup. — Students  who  were  tested  during  the 
last  week  of  10  weeks  of  normal  flying  training  and  who  had  not 
soloed  prior  to  Primary  training. 

2.  16-week,  nonsolo  group. — Students  who  were  tested  during  tho 
last  week  of  15  weeks  of  flying  training  (mado  up  of  tho  regular  10 

*  Since  the  frecse  also  coincided  with  the  cluing  of  approtlmately  half  of  the  Primary  schools  In  lb*  threa 
Flying  Training  Commands,  (be  upper  clui  from  (he  schools  w  hlch  had  Just  been  closed  »u  transferred  t# 
those  still  open.  Therefore,  only  students  with  army  aerial  number*  ending  In  the  range  00-31  wtra  tested; 
those  In  the  range  25-  .9  were  saved  for  a  later  control  test  on  the  effects  of  overcrowding.  This  test  was  not 
made  since  visits  to  the  schools  Indicated  that  they  had  been  able  to  cope  with  the  double  load.  See  foot¬ 
note  M  for  an  esplanatlon  of  why  students  with  army  serial  numbers  ending  In  the  range  fO-V 9  were  saved  for 
possible  further  study. 
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plus  5  additional  weeks  during  tho  freeze)  and  who  had  not  soloed 
prior  to  Primary  training* 

3.  10-week,  solo  group. — Students  who  were  tested  during  the  last 
week  of  10  weeks  of  normal  flying  training  and  who  had  soloed  prior 
to  Primary  training. 

4.  15-week,  solo  group. — Students  who  wero  tested  .during  tho  last 
week  of  15  weeks  of  flying  training  (mado  up  of  tho  regular  10  plus  5 
additional  weeks  during  tho  training  freeze)  and  who  had  soloed  prior 
to  Primary  training. 

Tho  number  and  typo  of  students  in  these  groups  at  each  level  of 
training  is  presented  in  table  10.1. 


Table  10.1. — Groupt  uted  in  the  final  comparitont  at  each  level  of  tingle-engine 

training 


Group  number . 

| 

1 

s 

4 

Level  of  training,  plane,  and  command 

10-week 

nonsolo 

15-week 

nonsolo 

10-week 

solo 

15-week 

solo 

Primary  students  trained  on  Strarmnn  plana 

In  eastern  and  western  flying  training  com- 
nianda . 

211 

Class  fS-C 

054 

Class  45-B 

00 

Class  45-C 

2» 

Class  45-B 

Beile  students  trained  on  I1T-1J  or  15  piano  In 
eastern,  erntral,  and  western  flying  training 

500 

710 

204 

221 

commands. . . 

Class  45-A 

Class  44- K 

Class  45-A 

Class  44-K 

Mtuntti  students  trained  on  AT-*  plana  In 

eastern  and  central  flying  training  com¬ 
mand! . 

42S 

Class  44-J 

001 

Class  44-1 

02 

Class  44-1 

110 

Clan  44-1 

10-week:  Ptudents  tested  during  the  last  wr-k  of  10  weeks  of  normnl  training  In  primary,  basle,  or  advanced. 
15-week:  Students  tested  In  primary,  basic,  or  advanced  during  the  last  week  of  training  made  up  of  tho 
normal  to  weeks  at  that  level  of  training  plus  the  6  additional  weeks  during  tho  training  freete. 
Nonsolo:  Students  who  had  not  had  enough  civilian  Hying  training  to  solo  before  entering  primary. 

Solo:  Students  who  bad  hod  enough  civilian  flying  training  to  solo  before  entering  primary. 


Results  for  Singlc*Engine  Students 

Tho  results  for  primary,  basic,  and  advanced  arc  presonted  in 
tables  10.2, 10.3,  and  10.4,  respectively.  Each  of  theso  tables  presents 
tho  percent  performing  correctly  for  tho  groups  with  tho  four  different 
amounts  of  training,  and  tho  reliability  of  tho  differences  among 
theso  groups. 

When  a  mcasuro  shows  a  significant  difference  botween  tho  groups 
compared,  this  means  not  only  that  tho  additional  training  produced 
an  improvement  but  also  that  tho  objective  mcasuro  employed  was 
good  enough  to  indicate  that  improvement.  When  no  significant  differ¬ 
ence  is  shown,  this  may  indicato  any  ono  or  moro  of  tlirco  things:  the 
particular  typo  of  training  produced  no  improvement,  tho  measure 
employed  was  not  rcliablo  and  discriminative  enough  to  indicato  tho 
improvement,  or  that  the  mcasuro  did  not  test  tho  particular  type  of 
improvement  that  occurred. 

Effects  of  6  weeks ’  additional  training  during  the  freeze. — Tho  most 
relevant  comparisons  for  determining  tho  cfTccts  of  tho  additional 
training  at  each  level  during  tho  freezo  aro  thoso  between  Group  1, 
10  wrecks  nonsolo,  and  Group  2,  15  weeks  nonsolo.  It  can  bo  seen 
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that  when  these  two  groups  were  tested  under  exactly  equivalent 
conditions,  the  students  with  tho  additional  training  gavo  a  measur¬ 
ably  better  performance  at  all  three  levels  of  training.  Tho  15-week 
group  was  better  than  tho  10-week  one  at  primary  on  all  13,  at  baste 
on  15  out  of  17  and  at  advanced  on  10  of  the  16  objective  measures 
used.1* 

In  primary,  most  improvement  was  shown  in  the  follow  ing  measures: 
(1)  Maintaining  constant  altitude  while  making  a  300°  steep  turn  to 
tho  right  immediately  followed  by  a  300°  steep  turn  to  tho  left;  (2) 
Performing  an  Immclmann  without  stalling,  starting  with  an  air  spcod 
no  greater  than  150  m.  p.  h.  and  coming  out  lined  up  within  45° of  tho 
correct  heading;  (3)  Performing  a  loop  without  stalling,  starting  with 
an  air  speed  no  greater  than  110  m.  p.  h.  and  coming  out  within  45° 
of  tho  correct  heading.  In  theso  threo  measures  tho  superiority  of 
the  15-week  group  was  of  a  size  which  would  bo  expected  by  chance 
less  than  1  time  in  100. 

Tadle  10.2.—  Objective  mtaturtt  of  the  efftclt  of  additional  training  on  tht  flying 

t kill  of  primary  ttudenlt 


Probability  of 

obtaining  by 

Percent  of  atudrnt *  per¬ 
forming  oorrectly 

chance  a  dHTrrenca  In  the 
eipected  direction  as  large  a* 
the  ore  observed  between  the 

groupa 

Group  number . 

1 

m 

S 

m 

Week’s  of  primary  flying  training . 

10 

10 

Hoi 

3>l 

4>3 

*>l 

4>3 

Folocd  before  entering  primary . 

No 

■rf 

Ye* 

Number  of  students  tested . 

211 

13 

40 

338 

tmmelmann.— Start*  with  atr  speed  less  than 
140  m.  p.  h.,  completes  wl.hout  stalling 
and  romes  out  within  <4*  of  correct  heading. 

■ 

0  01 

0.01 

air 

a  oo 

44 

63 

KJ 

Loop.— Starts  with  air  speed  less  than  1 10  m. 

p.  h..  completes  loop  without  stalling  and 
cornea  out  within  45”  of  original  heading... 

40 

44 

47 

44 

.01 

.13 

.17 

0) 

Strrp  Turn*.— Student  rolls  directly  from 

300*  left  turn  Into  3f«*  right  turn: 

71 

.01 

.44 

.01 

.03 

Altitude  deviation  no  more  than  to  fret.. 

40 

41 

70 

Ilenrhcd  fO"  bank  In  each  turn . 

73 

79 

77 

.01 

(•) 

.34 

10 

Roll-out  whhln  44*  original  heading . 

Forced  landing  —  l’lano  1,»j0  feet  right 
above  field  headed  downwind: 

98 

99 

100 

M 

Fl 

.11 

.03 

(») 

.31 

.13 

.13 

<•> 

.10 

Student  made  ft  base  let . . 

n 

M 

Would  make  first  $4  fletd  Ji  mile  square. 
Flrif  Accuracy  Landing.— l*owcr-ofI  00*  ap¬ 
proach  to  *ono  300  feet  wide  by  000  feet 
long: 

Landed  In  tone . 

44 

70 

to 

77 

.08 

(*) 

.01 

.01 

44 

61 

41 

63 

.04 

m 

.01 

.30 

.04 

44 

GO 

47 

44 

.04 

to 

.03 

Did  not  drop  In  or  bounce  3  feet.  . 

44 

69 

67 

43 

.14 

.30 

.39 

.14 

Second  Accuracy  Landing.— I’ower-olT  90*  *p- 

proach  to  ton*  300  feet  wide  by  000  feet 
long: 

Landed  In  ton# . . «... 

M 

40 

44 

4.1 

.14 

f»l 

.00 

.30 

47 

44 

HO 

73 

.03 

<0 

.01 

.01 

Did  not  drop  In  or  bounce  1  feet . . . 

6V 

41 

76 

43 

.30 

(•) 

.01 

■  No  different*  between  the  groupe. 

•nidiroiicc  between  the  group*  nut  In  the  riprckd  direction. 


••  Attempt*  to  conclude  tb*t  the  addition*!  training  at  one  level  was  of  mor*  Talue  than  that  at  anothe# 
are  not  Just  Iflcd.  Theeheck  rld<»  used  at  the  different  levels  are  not  necessarily  equivalent.  The  4  week* 
was  a  CO-percent  Increase  In  the  total  week*  of  flying  training  foe  »*.*  |<rlmary  student*,  ao4  l6H-p»r*vnl 
Inerenro  foe  those  lo  advanced,  furthermore.  It  It  possible  that  «  roukrd  Improvement  showing  up  at  tho 
end  of  the  primary  phase  may  he  entirely  obllli  rated  by  the  rime  the  tludent  giaduaU-a  front  a1! tranced 
training. 
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In  the  basic  schools  the  most  improvement  was  shown  in  the 
measures  of  instrument  flying.  These  were:  (1)  maintaining  constant 
heading,  air  speed  and  altitudo  in  strnight-and-lcvcl  instrument  flight; 
(2)  maintaining  constant  altitude  and  bank,  and  coming  out  on  the 
correct  heading  in  a  300°  steep  instrument  turn;  and  (3)  maintaining 
constant  heading  and  air  speed,  and  coming  out  at  the  correct  altitude 
in  a  constant  speed  climb  and  descent.  In  each  tho  9  measures 
involved  in  these  3  maneuvers,  tho  superiority  of  the  15-week  group 
was  of  a  size  that  would  bo  expected  by  chanco  less  than  once  in  100. 


Tadlk  10.3.- 


-Objective  measures  of  the  effects  of  additional  training  on  the  flying 
skill  of  basic  students 


Percent  of  students  per- 
forralne  correctly 


Cl  roup  number . 

Weeks  of  Ilrvslc  riv  ing  training  . 

Pnlocd  before  entering  Primary . 

Number  of  students  tested . I  699 


Strep  Turns.— Student  rolls  directly  from  ISO* 
left  turn  Into  If/)*  right  turn: 

Altitude  dovintloi  no  more  thnn  60  feet..  3.1 

Iteachcd  00*  bnnk  In  each  lum .  73 

Aenirnci  J.amtln}  m  rone  3)0  feet  wide  by 
COO  feet  long  using  throttle  and  Dip*  u 
desired: 

bonded  In  rone .  74 

l.nnded  In  3-i-olnt  Attitude .  TO 

I>ld  not  drop  In  or  bounee3  feet .  .  43 

/tr.unicr  Landing  in  rone  200  feet  wide  by 
600  fret  long  using  Gaps  aj  desired: 

l.nnded  In  rone  .  57 

l.nnded  In  3  |>olnt  Attitude  .  66 

Hid  not  drop  In  or  bounce  3  feet .  41 

.Sfrnl^f.f  an.!  l.tiel  Instrument  t'ligbt.— Student 
tiles  straight  and  level  nt  130  m.  n.  h.  for  3 
minutes  w  ttli  directional  gyro  and  artificial 
borlron  caged: 

Heading  deviation  no  more  thnn  10* . 

Air  i|H<<>d  deviation  no  more  than  6 

m.  p.  h .  63 

Altitudo  deviation  no  more  thnn  SO  feet  ..  41 

SCO*  Strep  instrument  Turn.— Makes  a  300* 
right  tum  w  ith  a  bnnk  of  over  30*  at  an 
air  speed  of  130  m.  p.  h.  and  comes  out  on 
beadlm*.  I’sc.s  full  Instrument  pAnel: 

Heading  deviation  no  more  than  6* . 

Altitude  deviation  no  more  than  100  feet.  03 

Maintained  at  least  a  30*  bnnk .  87 

Instrument  Cunstanl-Speei  Climb  and 
/frirrnf.—  Files  straight  and  level  »t  HO 
tn.  p,  h.,  climbs  l.ouo  feel  at  500  feet  per 
minute,  nnd  Immediately  starts  descent  to 
level  oil  at  starting  altitude: 

I  lending  deviation  no  more  than  10* .  73 

Air  spend  deviation  no  more  than  3  m.  p.  h.  27 

Level  oil  within  ffl  find  correct  Altitude 
top  of  climb  and  end  of  descent . 


38  41 
77  68 


74  |  77 

75 

44  I  48 


38  64 

67  68 

43  44 


60  51 

48  46 


69  I  69 
76 
91 


87  78 

37  29 

66  60 


•  No  difference  between  the  group*. 

'  Difference  between  tlio  groups  not  In  tha  expected  direction. 


Probability  of  obtaining  by 
chanco  a  difference  In  the 
expected  direction  as  large  as 
the  one  observed  between  tba 
groups 

J>1 

4>3 

%>l 

I>1 

0.03 

0.26 

0.02 

a  06 

.03 

.03 

<*) 

<*) 

(') 

(') 

.18 

P) 

.03 

(»> 

.13 

<•) 

.24 

.42 

.16 

.23 

<«) 

.41 

.03 

.01 

.23 

.23 

.21 

.11 

.34 

.16 

.22 

.01 

.01 

.10 

.22 

P> 

.01 

.15 

« 

ft 

.01 

.42 

.10 

« 

.01 

.06 

m 

ft 

.01 

.18 

.03 

.16 

.01 

.01 

<*) 

.01 

.01 

.18 

P>  . 

.01 

.01 

.29 

.11 

.01 

C) 

.16 

e> 

For  Advanced,  tho  group  with  moro  training  showed  tho  greatest 
superiority  in  tho  measures  on  tho  instrument  let-down  and  low 
approach;  they  wero  better  at  hitting  tho  edge  of  tho  field  “on  tho 
beam”  and  at  tho  proper  altitudo.  On  these  two  measures,  tho 
diffcrcnco  in  favor  of  tho  15-week  group  was  of  a  sizo  which  would  bo 
expected  by  chanco  less  than  1  timo  in  100. 
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Table  10.4. — Objective  measures  of  the  effect.,  of  additional  training  on  the  flying 
skill  of  advanced  single-engine  students 


Percent  of  students  per- 
forming  correctly 


Probability  of  obtaining  by 
chance  a  difference  In  tba 
circled  direction  u  large  at 
the  one  observed  between  tba 
group* 


Group  number  . 

Weeks  of  advanced  tlnglc-cnglne  flying 
training  . 


1 

9 

3. 

4 

!0 

11 

10 

18 

No 

No 

Yes 

Yes 

42$ 

931 

63 

116 

Two  Maitmum  Performance  Loops.— Starts 
with  nir  speed  leas  than  IfiO  m.  p.  h.,  1,921 
r.  p.  m.,  and  mnnlfold  pressuro  of  21"  llg., 
and  completes  loop  without  gulling  out: 
First  loop  Completed  without  stalling  or 

adding  throttle . 

Second  loop  completod  without  stalling 

or  adding  throttle . 

Steep  Turns.— Student  rolls  directly  from 
Iso’  left  turn  Into  IM>*  right  turn: 

Altitude  deviation  no  more  than  100  feet. 

Itcached  00’  bank  In  each  turn . 

Accuracy  l.nmltng  In  Zono  2U0  feet  wide  by 
000  feet  long  using  throttle  and  flaps  as 
desired: 

Landed  In  tone . _.. 

Landed  In  3-(>olnt  ntlltude . 

Did  not  drop  In  or  twunco  3  feet . 

Straight  and  Lent  Instrument  Flight.— Stud¬ 
ent  flies  straight  and  lovcl  at  130  m.  p.  h. 
for  3  minutes  with  directional  gyro  and 
artificial  horizon  caged: 

Heading  deviation  no  more  than  10* . 

Air  s|>ccd  deviation  no  moro  than  1 

m.  p.  h . 

Altitude  deviation  no  moro  than  SO  feet  . 
360 *  Steep  Instrument  Turn.— Mnkes  a  300* 
right  turn  with  a  hank  of  over  30*  at  an 
alrs|iecd  of  130  m.  p.  h.  and  comes  out  on 
heading.  Uses  full  Instrument  panel: 

Heading  deviation  no  moro  than  S* . 

Altiludo  deviation  no  moro  than  100  foot. 

Maintained  at  least  a  30*  hank . 

Instrument  1^1- Down  and  Loro  Avproaek.— 
Makes  a  regular  let-down  ana  low  ap¬ 
proach;  shakes  slick  nt  tho  proper  number 
of  seconds  after  tho  low  cone.  Starts  on 
the  beam  nt  projvr  altitude  about  I  min- 
uto  before  tho  high  cono  and  headed  to¬ 
ward  It: 

Jlcachcd  Iho  edge  of  the  field  no  more 

than  ton  feet  outside  of  Iho  hoain . 

Reached  Iho  edgo  of  tho  field  within  i 
s  conds  of  prescribed  tlmo  after  tha 

low  cone . 

Completed  let-down  within  BO  feet  of 
prescribed  altitude  at  edge  of  Held . 


17  63  84  64 

67  71  SO  7S 


13  17 

M  88 


78  73 

to  67 

33  41 


14  17 

&3  31 

13  48 


76  73 
M  Hi 
BO  89 


87  69 

64  86 


64  73 

67  76 

13  49 


31  48  I 

41  11  | 


73  61 

7V  81 

97  63 


IS  68  63  64 


44  47  W  41 

71  77  79  75 


0.04  Ol  IS  (i)  0  34 

.07  .  03  (•)  .11 

.01  .06  .31  .01 

-2»  -21  «  P> 


8  :!!  8  % 

.02  (•)  .03  .» 


.16  <0  .11  P> 

8  "»  8 


P)  -II  0)  .03 

.33  .36  (•)  Q 

V)  0)  .01  « 


.01  .41  .23  m 

.16  P)  .07  .63 

.01  P)  .01  P> 


•  No  difference  between  tbo  group*. 

1  Difference  between  tha  groups  not  In  tbt  exported  direction. 

For  tho  students  wlio  had  soloed  beforo  entering  Primary,  tho  addi¬ 
tional  five  weeks  of  training  produced  somo  improvement,  but  tha 
differences  were  not  as  large  or  consistent  os  they  wero  with  thoso  who 
hod  had  no  previous  flying  experience. 

Effect  of  having  had  enough  civilian  Jlying  training  to  solo  btjors 
entering  Primary. — At  tho  end  of  10  weeks  of  Primary  training  tho 
students  who  had  soloed  beforo  starting  military  flying  training  were 
better  than  those  who  had  not  received  this  training  in  all  13  of  tho 
objective  measures  used.  This  superiority  may  have  been  duo  to  tho 
additional  training  or  it  may  have  been  duo  to  a  selective  factor,  with 
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the  students  who  had  the  most  interest  and  nptitudo  taking  tho  trouble 
to  get  this  additional  training. 

The  superiority  of  the  students  who  had  had  enough  previous  flying 
training  to  solo  before  starting  military  flying  persisted  for  a  while  but 
became  progressively  smaller  in  tho  moro  advanced  phases  of  army 
training.  The  students  who  had  soloed  were  better  than  those  who 
had  not  in  10  out  of  tho  13  objective  measures  at  tho  end  of  15  weeks 
of  Primary  flying  and  in  13  out  of  17  at  tho  end  of  10  weeks  of  Basic 
flying.  By  tho  time  they  had  completed  15  weeks  of  Basic  flying 
training  the.  consistent  difference  lmd  disappeared;  there  was  no  con¬ 
sistent  difference  between  tho  solo  and  nonsolo  groups  in  tho  tests 
administered  at  the  end  of  15  weeks  of  Basic  flying  or  10  and  15  weeks 
of  Advanced  single-engine  training. 

These  results  arc  in  lino  with  wlmt  is  known  about  tho  way  having 
soloed  before  starting  army  flying  training  affects  tho  likelihood  that 
tho  student  will  be  eliminated.  The  students  who  had  already  soloed 
wero  considerably  less  likely  to  bo  eliminated  from  Primary  training 
than  thoso  who  had  not.  The  elimination  rates  for  a  typical  class  of 
approximately  7,000  students  were  0  percent  for  students  with  previous 
solo  and  33  percent  for  thoso  without  it.  By  the  time  these  students 
reached  Basic  schools  this  difference  was  greatly  reduced,  becoming 
8  percent  and  14  percent,  respectively.  Furthermore,  as  will  bo  shown 
in  tho  next  chapter,  the  students  with  previous  solo  aro  no  better  than 
thoso  without  it  in  tho  air-to-air  and  air-to-ground  fixed  gunnery 
practico  which  is  given  immediately  after  graduation  from  Advanced 
training. 

EFFECT  OF  ADDITIONAL  TRAINING  ON  ADVANCED 
TWO-ENGINE  FLYING  PROFICIENCY 

Groups  Compared 

Tho  fact  that  tho  advanced  two-engino  schools  wero  in  the  process 
of  changing  over  from  tho  AT-10  and  UC-78  planes  to  tho  much 
higher-powered  TB-25  introduced  certain  different  features  into  the 
design  of  tho  two-engine  section  of  tho  training  freezo  study. 

Students  wero  tested  in  only  these  schools  which  were  using  the 
TB-25.  In  all  of  theso  schools,  tho  students  with  10  weeks  of  Ad¬ 
vanced  training  had  received  all  of  it  on  tho  TB-25.  In  two  of  the 
schools,  tho  students  with  15  weeks  of  Advanced  training  had  received 
all  of  it  on  tho  TB-25;  in  two  other  schools,  however,  students  who 
lmd  received  10  weeks  of  training  on  tho  lower-powered  AT-10  or 
UC— 78  received  5  weeks  of  additional  training  on  tho  much  higher- 
powered  TB-25  during  tho  first  training  freeze.  This  meant  that, 
although  they  had  a  total  of  15  weeks  Advanced  training,  only  5 
weeks  of  this  training  had  been  on  tho  higher-powered  TB-25. 
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So  few  Advanced  two-engine  students  had  soloed  beforo  entering 
Primary  flying  training  that  they  were  not  sorted  out  of  tho  samplo 
for  sepnrato  analysis.  All  students  wero  tested  on  tho  TB-25. 
Hold-overs  were  excluded. 

The  composition  of  the  tlirco  groups  compared  in  tho  Advanced 
two-engine  study  was  as  follows: 

1.  10-5-week  group. — Tho  students  in  this  group  had  received  10 
weeks  of  Advanced  two-engine  training  on  tho  UC-78  or  AT-10  and 
5  weeks  of  training  on  tho  TB-25.  Tho  group  consisted  of  290 
students  in  Class  44-1. 

2.  0-10-week  group. — Tho  students  in  this  group  had  received  tho 
normal  10  weeks  of  Advanced  two-engino  training  on  tho  TB-25. 
The  group  consisted  of  730  students  in  Class  44-J. 

3.  0-15-week  group. — The  students  in  this  group  had  received  tho 
normal  10  weeks  of  Advanced  two-engino  training  on  tho  TB-25 
plus  5  weeks  of  additional  training  on  tho  samo  piano  during  tho 
training  freeze.  The  group  consisted  of  275  students  in  Class  44-1. 

Results  of  Comparing  Different  Types  of  Advanced  Two-Engine  Training 

Measures  on  a  sample  maneuver. — First,  tho  results  for  ono  samplo 
maneuver,  singlc-engino  procedure,  will  bo  considered.  In  this 
maneuver,  when  tho  student  was  flying  under  standard  conditions, 
the  instructor  cut  ono  throttlo  completely  and  thus  simulated  tho 
condition  of  ono  engino  failing.  Tho  student’s  task  was  to  keep  tho 
plane  from  swerving  toward  tho  dead  engino,  go  through  tho  proper 
procedure  of  feathering  tho  dead  propeller  and  increasing  power  in 
the  good  engino,  and  hold  tho  loss  of  air  speed  and  altitudo  to  ft 
minimum. 

Tho  results  aro  presented  in  flguro  10.1.  It  can  bo  seen  that  tho 
three  groups  wero  not  different  in  their  ability  to  hold  heading.  In 
the  important  aspects  of  holding  airspeed  and  altitude,  howover, 
there  was  progressive  improvement  with  additional  training  on  tho 
TB-25.  It  is  especially  interesting  to  noto  that  students  with  only 
10  weeks  of  Advanced  training,  all  on  tho  TB-25,  wero  definitely 
better  than  those  with  a  total  of  15  weeks  Advanced  training,  10  of 
which  wero  on  a  lower-powered  piano.  Apparently  tho  transfer  of 
training  was  imperfect  enough  so  that  tho  10  weeks  on  tho  lower- 
powered  plane  did  not  help  as  much  as  5  weeks  on  tho  higher-powered 
TB-25. 

The  final  measure  on  tho  graph,  “Following  tho  Procedure  Cheek 
List/’  must  bo  interpreted  in  tho  light  of  tho  fact  that  proper  pro¬ 
cedures  were  stressed  during  tho  first  few  weeks  of  training  on  tho 
TB-25  and  relatively  neglected  after  that.  Tho  progressive)  forgetting 
shown  in  tho  graph  clearly  indicates  tho  need  for  more  review  on  this 
aspect  of  training. 
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RESULT  $  ON  ONE  O'  THE  MANEUVERS  UUO  TO 
MEASURE  OBJECTIVELY  EFFECTS  OF  AOOiTlONAl  TRAVfIN# 
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pleasures  on  all  maneuvers, — Tho  results  on  nil  of  tho  measures  used 
at  the  advanced  two-engino  level  of  training  aro  shown  in  Tablo  10.5. 

The  chief  findings  wero: 

1.  In  general,  tho  students  with  15  weeks  of  advanced  two-engine 
training,  but  only  5  of  theso  on  tho  TB-25,  gavo  a  poorer  performance 
than  thoso  with  only  10  weeks  of  advanced  two-engino  training,  all 
of  which  was  on  tho  TB-25.  Tho  10-5- Week  group  was  poorer  than 
the  0-10- Week  ono  on  18  of  tho  20  objective  measures  used.  Appar¬ 
ently  tho  transfer  of  training  was  imperfect  enough  so  that  tho  10 
weeks  on  tho  lower-powered  piano  did  not  help  os  much  os  5  weeks 
on  the  higher-powered  one. 

Table  10.5.— Objective  measures  of  the  effects  of  additional  training  on  the  flying 
skill  of  advanced  two-engine  students 


I 

l 


Percent  of  jttn- 
dents  performlnf 
correctly 


Probability  n t  obtaining  by 
chance  •  different-©  In  either 
direction  u  large  u  the  one 
observed  between  the 
troupe' 


Group  number . . 

Weeks  of  advanced  flying  training  on  light  two-cnglne 

planes  (lTC-78,  AT-IO) . . 

Weeks  of  advanced  flying  training  on  heavy  two- 

engine  plane  (TB-21) . 

Number  of  students  tested . . 


Single-h.'nglne  Procedure.— Starting  conditions:  wheels 
down,  cardinal  heading,  air  speed  100  m.  p.  h.,  2.300 
r.  n.  m.  and  enough  manifold  pressure  to  maintain 
ICO  m.  p.  h.: 

Maintained  heading  within  8* . 

Held  nlr  speed  to  IJO  m.  p.  h.  or  over . 

Altltudo  loss  less  than  100  feet . 

Troccduro  cheek-list  followed  correctly  . 

Single- Pngine  landing.— Check  pilot  cuts  Inride  enplne 
after  completion  of  tbs  O  CM  1*  check  on  downward 
let: 

Lined  up  with  runway  after  turn  Into  approach 
Held  MO  m.  p.  h.  air  speed  on  approach  w  ithin  10 

in .  p.  h . 

Cheeked  gear  on  approach . 

Cut  tiower  at  roumlout  or  landing . 

Landed  In  100  foot  target  rone  of  runway . 

Did  not  land  In  skid . 

Straight  and  Lerel  Jmlrum  Plight.— Student  fllea 
straight  and  lovel  and  normal  cruising  nlr  six-cd  for 
3  minutes  with  directional  gyro  and  artificial  horizon 
cored: 

Heading  dot  lotion  no  more  than  8* . 

Air  sliced  deviation  no  more  than  3  m.  p.  h. . 

Altitude  deviation  no  more  than  10  feet . 

Instrument  Let-Damn  and  Lett  Approach.— Make*  a 
regular  let-down  and  low  approach;  shakes  th«  stick 
at  tho  proiior  number  of  seconds  nfter  the  low  cone. 
Starts  on  tho  beam  at  proper  altitude  about  one 
minute  before  tho  high  tone  am)  hendod  toward  It: 
Kcachcd  tho  edgo  of  tho  flcld  no  more  then  400  ft. 

outside  of  tho  lieam . 

Reached  tho  edgo  of  the  field  within  8  seconds  of 

prescribed  tlmo  after  tho  low  cone . 

Completed  let-down  within  40  ft.  of  prescribed 

altitude  at  odgo  of  field . 

Peuer-af  Approach  and  Landing.— Makes  t  powerofl 
approach  and  landing.  Cuts  power  completely  et 
traffic  altltudo  when  In  position  to  land  In  the  target 
lono  w  ith  power  off  all  the  way  down: 

Altltudo  at  roll  Into  approach  dovlated  no  more 

than  100  ft.  from  prescribed  altitude . 

Did  not  add  power  on  approach . 

Landed  In  target  ton*  without  adding  power.... 
Landed  In  target  tono  after  adding  power....... 
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» No  difference  between  the  groups.  .  .  . .  .  , 

i  In  computing  theso  probabilities  t-oth  tails  of  tho  distribution  were  used  beratua  there  was  no  a  yrlar 
reason  for  ripectlng  the  UUIerenc*  between  groups  to  be  la  a  psrtleular  direction. 
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2.  Although  the  students  with  15  weeks  of  training  on  the  TB-25 
in  general  tended  to  bo  the  best,  the  additional  advanced  two-engine 
training  did  not  improve  skill  on  all  of  tho  aspects  of  performance 
measured. 

a.  Most  improvement  was  shown  in  hitting  the  edge  of  tho  field 
“on  the  beam"  at  the  correct  altitude  on  the  instrument  let-down 
and  low  approach,  and  in  maintaining  altitude  and  air  speed  on  tho 
singlc-cngino  procedure. 

b.  In  the  single-engine  procedure,  however,  tho  students  with  more 
training  wore  progressively  more  careless  about  performing  tho  whole 
procedure  check  list  correctly.  Thoso  with  15  weeks  of  training  on 
the  TB-25  were  also  somewhat  more  likely  to  omit  the  landing  gear 
check  on  the  single-engine  landings;  in  fact,  a  surprisingly  high  pro¬ 
portion,  more  than  45  percent,  of  all  students  failed  to  check  their 
landing  gear  after  lowering  it  on  approach.  Procedure  items  were 
stressed  during  the  first  part  of  training  and  apparently  were  not  i 
reviewed  enough  during  the  latter  part  of  the  course  to  mako  up  for 
the  effects  of  forgetting. 

SUMMARY  AND  CONCLUSIONS 

f 

While  it  was  still  in  the  early  stages  of  developing  objective  meas¬ 
ures  of  flying  skill,  tho  Pilot  Project  was  asked  by  the  Chief  of  Staff 
of  tho  Training  Command  to  use  the  opportunity  afforded  by  tem¬ 
porary  training  freezes  to  develop  objective  measures  for  all  levels  of 
training  and  to  mensuro  tho  effects  of  additional  training  at  each 
level. 

With  the  aid  of  pilots  on  Training  Advisory  and  Standardization 
Boards,  objectivo  chcck-ridc  scales  were  developed  for  each  of  the 
phases  of  training:  Primary,  basic,  advanced  singlc-cngino  and  ad¬ 
vanced  two-engine.  Tho  measures  in  theso  check  rides  were  designed 
to  sample  differences  between  groups;  they  were  not  designed  to  bo 
reliable  enough  to  discriminate  between  individuals. 

These  objective  measures  were  administered  during  a  single  week 
to  over  8,000  students  in  tho  four  different  phases  of  training.  When 
tho  students  whoso  selection  or  training  was  ntypical  were  sorted 
out  to  purify  tho  samples,  tho  population  was  reduced  to  6,052 
students. 

In  the  primary,  basic,  and  advanced  single-engine  schools,  students 
who  had  received  tho  normal  10  weeks  of  training  and  students  who 
had  received  an  additional  5  weeks  during  the  freeze  (making  a  total 
of  15  weeks)  wero  tested  at  the  samo  time  under  comparable  con¬ 
ditions.  Tho  results  showed  that  at  each  of  these  threo  levels  of 
singlc-cngino  training,  adding  an  additional  5  weeks  produced  a 
definito  improvement  in  tho  performance  of  the  students.  At  none 
of  these  lovels  had  tho  students  reached  their  limit  of  improvement 
within  tho  normal  period  of  training. 
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At  the  advanced  two-engine  schools  three  different  groups  wero 
tested  on  tho  TB-25.  One  of  these  had  received  10  weeks  of  normal 
advanced  two-engine  training  on  the  lower-powered  UC-78  or  AT-10 
followed  by  5  weeks  on  the  faster  and  heavier  TB-25.  Other  students 
had  received  10  and  15  weeks  of  advanced  two-ongino  training, 
respectively,  all  on  tho  TB-25.  The  results  of  testing  showed  that 
in  general  10  weeks  of  advanced  two-engine  training,  all  on  tho  TB-25, 
was  better  than  15  weeks  of  training,  10  of  which  was  on  lower- 
powered  two-engine  planes  and  only  5  on  tho  TB-25.  Apparently, 
the  transfer  of  training  was  imperfect  enough  so  that  5  weeks  on  tho 
larger  plane  was  of  more  value  than  10  on  the  smaller  ono. 

In  general,  the  students  with  15  weeks  of  training,  all  on  tho  TB-25, 
were  the  best  of  all,  but  the  additional  training  did  not  help  all  aspects 
of  performance.  During  tho  additional  training  there  was  a  ten¬ 
dency  to  forget  those  aspects  of  procedure  which  wero  emphasized 
during  the  first  weeks  and  relatively  neglected  later  on. 

An  investigation  was  also  made  of  the  difference  between  thoso 
single-engine  students  who  had  had  enough  civilian  flying  training 
to  solo  before  entering  primary  and  those  who  had  not.  It  was 
found  that  during  the  earlier  phases  of  military  training  the  students 
who  had  soloed  before  primary  were  definitely  superior  to  thoso  who 
had  not.  But  the  difference  between  these  two  groups  did  not  seem 
to  persist  beyond  tho  basic  level  of  flying  training.  Thoso  results 
arc  in  lino  with  what  is  known  about  tho  effects  of  previous  civilian 
flying  upon  the  likelihood  that  the  student  will  bo  eliminated  at  tho 
different  levels  of  training. 

Tho  fact  that  it  was  possible  to  achieve  the  results  reported  when 
objcctivo  measures  wero  used  at  36  different  schools  to  test  tho  flying 
skill  of  over  8,000  students  in  a  single  week,  indicates  that  it  is  prac¬ 
ticable  to  employ  such  measures  in  evaluating  the  results  of  a  largo- 
scnlo  pilot  training  program. 
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CHAPTER  ELEVEN— 


Fixed  Gunnery  as  an  Objective 
Measure  of  Flying  Skill 

Sgt.  John  G.  Gleason 


JOB  ANALYSIS  OF  THE  FIXED  GUNNERY  TASK  IN  TIIE 
TRAINING  COMMAND  » 

An  important  aspect  of  a  fighter-pilot’s  task  was  to  register  hits 
on  air  and  ground  targets  by  firing  guns  fixed  to  his  plane.  Therefore, 
the  ability  to  hit  similar  targets  while  in  training  constituted  an 
objective  measure  of  one  important  area  of  fighter-pilot  proficiency. 

The  pilot’s  task  in  fixed  gunnery  firing  involved  two  major  skills: 
(1)  perceptual  skill  in  evaluating  the  aim  and  (2)  skill  in  Hying  tho 
plane  so  as  to  obtain  and  keep  the  correct  aim  while  maintaining 
smoothly  coordinated  flight.  A  high  degree  of  both  of  these  skills 
was  needed;  the  development  of  either  without  the  other  was  valueless. 

The  sight  picture  in  fixed  gunnery  is  different  from  the  sight  picture 
obtained  with  any  conventional  gun  sight.  A  summary  of  the  sight 
picture,  as  the  fighter-pilot  sees  it  when  using  the  optical  gun  sight, 
is  presented  in  the  following  paragraphs.  No  attempt  is  mado  in 
this  discussion  to  explain  the  optics  of  this  sight. 

As  the  pilot  is  seated  in  the  cockpit,  he  looks  straight  ahead  through 
a  tilted  glass  reflector  plate.  The  glass  appears  perfectly  clear,  except 
for  the  lighted  image  of  the  sight.  The  sight  appears  ns  a  ring  with 
a  head  as  its  center. 

The  sight  is  so  installed  in  the  plane  that  it  is  harmonized  with  tho 
path  of  the  bullets  and  the  path  of  the  plane.  That  is,  the  sight,  tho 
airplane,  and  the  gun  arc  all  aligned  in  such  a  manner  that,  within 
the  effective  range  of  the  gun,  the  bead  of  the  sight  indicates  the  path 
tho  bullets  follow.  Tho  image  of  the  sight  appears  out  in  space  at 
the  distance  at  which  the  pilot's  eyes  are  focused.  The  pilot  may  movo 
his  head  about  in  any  direction  and  the  sight  image  which  appears 
out  in  spaco  will  continue  to  indicate  the  same  point  of  aim. 

The  ring  of  tho  sight  measures  angular  distance,  i.  e.,  tho  distanco 
between  the  bead  and  any  point  on  the  ring  of  the  sight  is  a  measure 
of  angular  distance.  This  measure  of  angular  distance  serves  two 
functions:  if  tho  pilot  knows  the  size  of  a  target  he  can  estimate  its 
range;  if  he  knows  its  speed,  he  can  estimate  the  angle  by  which  ho 
must  lead  it. 

*  Work  lo  this  Mellon  w»s  done  by  fit.  /oho  0.  OJr»ioo. 
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The  apparent  diameter  of  the  ring  used  in  the  training  sight  was  84 
feet  at  a  range  of  1,200  feet,  the  maximum  rango  for  efTcctivo  firing. 
Knowing  this,  the  pilot  needed  only  know  what  portion  of  his  sight 
ring  the  target  should  fill  in  order  to  determine  whether  ho  was  in  or 
out  of  range.  For  example,  in  air-to-air  firing,  a  tow  target  20  feet 
long  was  employed.  When  this  target  was  viewed  broadside,  it  filled 
one  quarter  of  the  ring  at  a  rango  of  1,200  feet.  If  the  target  wero 
closer  than  1,200  feet,  it  would  appear  to  fill  moro  than  one  quarter  of 
the  ling;  or,  if  the  target  were  more  than  1,200  feet  away,  it  would 
appear  to  fill  less  than  one  quarter  of  the  ring. 

A  target  moving  straight  away  from  the  pilot  docs  not  appear  to 
move  across  his  line  of  sight  and  can  be  hit  by  aiming  directly  at  it. 
For  any  target  which  is  moving  across  the  line  of  sight,  howover,  the 
pilot  must  aim  ahead  of  it  to  hit  it.  There  is  no  accurato  way  of 
measuring  lead  with  the  conventional  sight.  The  ring  and  bead  of 
tho  optical  sight  givo  a  basis  for  estimating  angle  of  lead.  Since  the 
angle  of  lead  remains  constant  (for  any  given  target  speed)  regardless 
of  changes  in  range,  and  since  the  optical  sight  measures  tho  angle  of 
lead,  it  is  unnecessary  to  know  the  distance  to  tho  target  in  order  to 
determine  the  proper  lead. 

To  obtain  maximum  effectiveness  against  a  moving  target  tho  pilot 
had  to  bo  able  to  fire  at  it  for  a  period  of  time.  Tho  only  way  m 
which  a  pilot  could  do  this,  without  undue  exposure  to  defensive  fire 
from  the  attacked  aircraft,  was  to  attack  from  the  side,  turning  with 
the  target  and  firing  while  turning.  Such  a  path  of  flight,  which  keeps 
the  target  constantly  under  fire,  is  called  a  "curvo  of  pursuit.” 

In  firing  on  a  target,  while  flying  a  "curve  of  pursuit,”  both  tho 
angle  of  fire  on  the  target  and  the  angle  of  lead  changes.  Tho  maxi¬ 
mum  angular  lead  is  required  when  firing  at  right  angles  to  tho  path 
of  the  target  and  vnrics  to  no  lead  when  the  attack  is  from  behind  or 
ahead. 

The  angle  determined  by  tho  bead  and  ring  of  the  sight  used  in 
training  was  such  that  when  firing  at  a  90°  angle  to  a  target  moving 
G5  miles  per  hour,  the  correct  lead  was  1  radius,  or  in  other  words,  tho 
angle  formed  between  the  bend  and  any  point  on  the  ring.  If  tho 
target  moved  twice  as  fast,  or  130  miles  per  hour,  as  did  the  tow  target 
used  in  training,  the  lend  also  had  to  be  doubled  and  therefore  beenmo 
2  radii. 

The  pilot’s  angular  lend  vnrics  ns  tho  sine  of  the  angle  of  attack. 
Since  it  was  obviously  impossible  for  tho  pilot  to  estimate  each  change 
in  angle  of  attack  with  extreme  accuracy,  he  lenrned  tho  correct  lead 
for  several  angles  of  attack  that  wero  easy  for  him  to  estimate  accu¬ 
rately.  Gunnery  students  usunlly  learned  the  sight  picture  for  every 
15°  as  follows: 


Angle  of  attack:  HadituUU 

00* . 2.0  radii 

75* .  1.0  radii 

00° .  1.7  radii 

45* .  1.4  radii 

30* .  1.0  radii 

15° . 0.5  radii 


The  pilot  then  flew  the  plane  os  smoothly  os  possible  from  one  known 
sight  picture  to  the  next  so  tlmt  the  lead  wos  gradually  but  con¬ 
stantly  changing. 

As  can  bo  seen,  the  pilot  had  to  make  two  related  judgments.  He 
had  to  recognize  ti'.c  sight  picture  which  gavo  each  of  the  listed  radii 
lead.  This  required  that  the  pilot  hove  good  perceptual  memory. 
He  also  had  to  he  able  to  judge  accurately  his  anglo  off,  i.  e.,  judge  the 
angle  between  the  path  of  his  bullets  and  tho  path  of  the  target,  in 
order  that  he  would  use  the  correct  sight  picture.  If  ho  erred  in 
either  of  these  two  judgments  ho  would  not  hit  the  target.  With 
practice,  these  two  judgments  were  reduced  to  one. 

With  the  preceding  description  of  the  optical  gun  sight  os  a  back¬ 
ground,  we  can  now  consider  the  specific  task  presented  to  the  gun¬ 
nery  student  in  training. 

Air-to-Ground  Fixed  Gunnery 

This  was  tho  less  difficult  of  the  two  types  of  fixed  gunnery  task. 
Air-to-ground  training  was  given  to  familiarize  tho  student  with 
attacking  ground  targets.  In  combat,  such  targets  included  tanks, 
trains,  grounded  aircraft  and  ships.  In  training  a  6  by  0  foot  riflo 
target  inclined  at  a  GO0  angle  was  used. 

The  attack  consisted  of  a  shallow  dive  (30°)  with  the  bead  of  the 
sight  centered  on  tho  target.  The  dive  was  started  from  an  altitude 
of  800  feet  abovo  the  ground  and  carried  the  plane  down  to  approxi¬ 
mately  300  feet.  The  dive  wos  made  at  a  speed  of  approximately  150 
miles  per  hour.  Firing  wos  started  when  the  plane  camo  within 
range,  os  indicated  by  a  white  line  on  the  ground  1,200  feet  from  tho 
target.  Firing  stopped  before  the  plane  passed  the  foul  line,  indi¬ 
cated  by  a  second  white  line  on  the  ground,  GOO  feet  from  tho  target. 
On  passing  this  point  the  pilot  immediately  began  a  climbing  turn 
back  to  normal  altitude  in  preparation  for  the  next  attack  on  the 
target. 

Hitting  the  target  on  a  calm  day  required  the  pilot  to  fly  tho  plane 
in  a  perfectly  coordinated  dive  at  the  target  aiming  the  plane  so  that 
tho  bead  of  the  sight  wos  on  the  bull’s-eye.  When  firing  in  any  wind, 
a  correction  in  sighting  had  to  be  inode.  The  sight  had  no  adjustment 
for  wind  correction  so  the  allowance  for  windage  was  made  by  aiming 
slightly  off  tho  bull’s-eye.  When  flying  in  a  crosswiiul,  the  pilot 
aimed  slightly  upwind  of  the  bull’s-eye  to  allow  for  the  downwind 
drift  of  tho  bullets.  In  order  for  the  pilot  to  hold  such  a  point  of 
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aim  in  ft  crosswind,  it  was  necessary  for  him  to  fly  a  very  slight, 
coordinated  turn.  In  a  headwind,  the  pilot  aimed  high  and  in  a 
tailwind  he  aimed  low. 

The  Hying  task  in  air-to-ground  fixed  gunnery  wns  largely  a  matter 
of  coordinated  Hying.  The  slightest  slip  or  skid  of  the  piano  while 
sighting  on  the  bulPs-cyc  caused  the  bullets  to  go  wide  of  the  target. 
At  a  range  of  1,200  feet,  a  skid  of  only  5°  caused  the  bullets  to  miss  the 
target  by  13  feet. 

The  perceptual  aspect  of  the  air-to-ground  gunnery  problem  was 
relatively  simple.  The  pilot  needed  only  to  see  whether  the  bead  was 
on  the  target  or  not.  Errors  diic  to  the  effect  of  tho  wind  were  immed¬ 
iately  noted  from  spurts  of  earth  thrown  up  by  tho  bullets  and  corre¬ 
sponding  corrections  in  aim  could  bo  made. 

Air-to-Air  Fixed  Gunnery 

This  was  the  more  difficult  typo  of  fixed  gunnery  firing  and  required 
good  judgment  of  relative  speed  and  distance,  accurate  judgment  of 
angles,  perception  of  the  correct  sight  pictures  and  precision  flying. 
It  was  in  this  typo  of  firing  that  tho  optical  sight,  described  earlier, 
was  most  valuablo. 

Tho  purposo  of  air-to-air  firing  was  to  familiarizo  tho  student  with 
the  task  of  attacking  another  aircraft.  Tho  training  closely  simulated 
an  attack  on  a  large  aircraft  whoso  ability  to  perform  evasivo  action 
was  negligible.  A  banner  type  target  measuring  4  feet  by  20  feet  was 
used  and  was  towed  behind  an  AT-6  typo  aircraft. 

Tho  procedure  in  air-to-air  fixed  gunnery  W’as  for  a  flight  of  seven 
planes  to  be  assigned  a  specific  range  and  altitude  for  firing.  Tho  tow 
ship  towed  tho  target  straight  and  level  at  an  air  speed  of  130  miles 
per  hour,  back  and  forth  over  the  rango.  Tho  target  was  towrcd  in  this 
manner  for  all  air-to-air  fixed  gunnery  practico  so  that  tho  studonts 
could  devote  all  of  their  attention  to  timing  their  approach  and  deter¬ 
mining  the  correct  position  to  open  firo. 

In  flying  an  air-to-air  guimcry  mission  tho  pilot  approached  tho 
targot  by  flying  parallel  to  its  path  but  in  tho  opposite  direction. 
Wien  tho  target  appeared  off  at  a  45°  anglo  to  his  lino  of  flight,  tho 
pilot  began  to  roll  into  his  curvo  of  pursuit.  As  tho  pilot  continued 
tho  turn  ho  reached  an  anglo  of  firo  of  90°  when  ho  was  approximately 
1,200  feet  from  tho  target.  By  tho  timo  this  anglo  of  firo  had  been 
closed  to  00°  tho  target  was  w’cll  “sighted"  and  firing  begun.  It 
continued  until  tho  anglo  of  firo  approached  30°  when  tho  pilot  was 
forced  to  break  of T  tho  attack  in  order  not  to  endanger  tho  tow  ship. 
The  pilot  then  regained  his  position  in  traffic  to  prepare  for  tho  next 
attack  on  tho  target. 

Hitting  tho  towed  target  required  a  number  of  higldy  developed 
skills.  First,  tho  pilot  needed  to  judgo  tho  proper  distance  from  tho 
path  of  tho  target  to  begin  his  approach.  This  was  difficult  because 
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of  the  high  rate  of  closure  (2S0  miles  per  hour)  between  the  attacking 
piano  and  the  target.  Although  difficult,  the  task  was  crucial,  sinco, 
if  his  path  wero  too  close  to  the  target  when  tho  turn  was  started,  it 
forced  tho  pilot  into  an  impossibly  tight  curvo  of  pursuit  resulting  in 
only  a  brief  instant  in  which  tho  proper  lead  could  be  obtained  before 
tho  pilot  could  no  longer  turn  fast  enough  to  keep  tho  target  in  his 
sights.  Should  his  path  bo  too  far  out  from  tho  target's  path  when 
tho  turn  was  started,  the  pilot  found  liimsclf  unable  to  get  in  range  to 
firo.  An  allied  problem  of  judgment  was  tho  timing  of  tho  start  of 
the  roll  into  the  curve  of  pursuit.  The  penalties  for  error  hero  were 
approximately  the  samo  as  those  for  misjudging  distance.  If  the 
roll-in  were  started  too  soon,  tho  pilot  would  not  bo  able  to  turn  with 
the  target  since  he  was  too  close  in  by  tho  time  it  reached  him,  or  if  tho 
turn  were  started  too  late,  ho  was  never  ablo  to  get  within  range  to 
open  fire. 

The  pilot  also  had  tho  perceptual  task  of  judging  his  rango  and 
his  angle  of  fire,  so  that  ho  could  apply  the  correct  sight  picturo.  Ho 
had  to  visualize  the  correct  sight  picture  for  each  angle  of  firo,  and 
hold  the  plane  on  the  course  which  maintained  the  correct  lead. 

Throughout  all  this  action  the  pilot  had  to  maintain  perfectly  co¬ 
ordinated  flight.  As  in  uir-to-ground  firing,  the  slightest  slip  or  skid 
of  the  aircraft  tlucw  the  bullets  wide  of  their  mark. 

In  brief,  then,  in  air-to-ground  fixed  gunnery,  the  chief  problems 
were  the  coordinated  flying  of  a  30°  dive  and  correcting  for  drift.  In 
air-to-air  firing,  tho  task  of  coordinated  flying  was  again  of  basio 
importance  but  the  level  of  difficulty  of  the  maneuver  was  greatly 
increased.  The  curvo  of  pursuit  was  a  steep  turn  requiring  tho  pilot 
to  fly  the  plane  near  its  limits  of  performance.  In  addition,  tho  pilot 
had  to  make  accurate  judgments  of  speed  and  distanco  in  order  to 
placo  and  time  his  curve  of  pursuit  properly.  Finally,  in  order  to  fly 
the  curve  correctly,  the  pilot  had  to  judge  his  angle  of  fire  with  ac¬ 
curacy  while  simultaneously  achieving  the  proper  sight  picturo  for 
each  anglo. 

EVALUATION  OF  FIXED  GUNNERY  SCORES  AS 
CRITERION  DATA  " 

Importance  of  Evaluating  Fixed-Gunnery  Scores  as  Criterion  Data 

The  job  analysis  of  the  student's  task  in  tho  two  types  of  fixed 
gunnery  training  shows  that  flying  skill  is  an  important  factor  in  both. 
It  is  quite  possible,  however,  for  a  mensuro  to  appear  objective  and 
logical  and  yet  to  be  so  distorted  by  extraneous  factors,  over  which 
little  or  no  control  may  be  exercised,  that  tho  scores  ore  so  unreliable 
that  they  do  not  measure  the  level  of  ability  of  the  students. 

*  Eietpl  where  othf rwLv  •pcflflcl,  work  In  Ihli  vcllon  *u  <lon«  bjr  M»J.  OWn  L.  Ilr»ib.r*,  LI.  IVillUn 
E.  Quit,  Lt.  Rtlpb  M.  nun,  tin!  Bf  t.  John  O,  Olruon. 
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Reliability  of  Air-to-Ground  and  Air-to-Air  Fixed  Cunnery  Scores 

The  term  reliability  refers  to  the  consistency  of  r  teasurement.  The 
gunnery  scores  would  be  said  to  be  highly  reliable  if  tho  student  pilots 
who  scored  high  on  the  odd-numbered  gunnery  missions  also  scored 
high  on  the  even-numbered  missions  and  if  the  students  who  scored  low 
on  the  odd-numbered  missions  also  scored  low  on  the  even-numbered 
missions.  Jf  the  scores  on  the  odd  missions  did  not  agree  with  tho  scores 
on  the  even  missions,  it  could  hardly  bo  expected  that  they  would  be 
related  to  anything  else.  If  tho  pilots  who  scored  highest  on  one 
mission  are  just  ns  likely  ns  any  others  to  score  the  lowest  on  the  next, 
the  scores  wotdd  not  bo  a  measure  of  their  fixed  gunnery  ability. 

It  was  possible  that  tho  results  of  a  few  rounds  of  firing  would  give 
an  unreliable  picture  of  the  proficiency  of  the  pilot,  while  thoso  of 
many  rounds  fired  during  a  number  of  successive  missions  would  give 
a  rcliablo  measure.  It  was  therefore  dosirablo  to  know  how  many 
rounds  lmd  to  be  fired  in  order  to  secure  n  rcliablo  score. 

Since,  in  general,  the  reliability  of  a  score  is  increased  by  increasing 
tho  number  of  measurements  included,  the  determinations  of  relia¬ 
bility  w'crc  based  on  the  same  number  of  rounds  ns  were  tho  gunnery 
scores  used  in  tho  validation  of  the  classification  tests.  By  inspection 
of  tho  data,  it  was  determined  that  tho  greatest  number  of  rounds 
fired  by  all  students  was  1,200  rounds  air-to-air  and  400  rounds  air-to- 
ground.  The  reliability  measures  wero  therefore  based  upon  these 
numbers  of  rounds. 

Tho  reliabilities  were  determined  by  product-moment  correlation 
of  scores  on  odd-  and  oven-numbered  missions.  Normally  from  two 
to  threo  missions  wero  flown  in  a  day.  A  mission  equalled  100  rounds 
fired  in  all  cases  except  air-to-air  firing  in  tho  Eastern  Flying  Training 
Command.  There  tho  first  air-to-air  mission  was  100  rounds  and  all 
succeeding  missions  were  200  rounds.  In  instances  w'hcro  a  student 
fired  less  than  tho  100  or  200  rounds  prescribed,  tho  scores  wero  mado 
comparable  by  the  uso  of  the  percent  of  hits  mado.  Tho  mission  was 
omitted  entirely  from  tho  calculations  when  less  than  25  rounds  wero 
fired. 

Tho  means,  sigmas,  and  reliability  coefficients  ns  determined  for 
Class  44-1-G  from  Western  Flying  Training  Command,  44-1-H  from 
Central  Flying  Training  Command,  and  Class  44-1-H  from  Eastern 
Flying  Training  Command  are  presented  in  table  11.1  for  Air-to- 
Ground  Fixed  Gunnery,  and  tablo  11.2  for  Air-to-Air  Fixed  Gunnery. 
Tho  reliability  coefficients  wero  corrected  for  doublo  length  by  uso  of 
tho  Spearman-Brown  formula.  The  averago  reliability  for  all  schools 
and  commands  combined  by  use  of  Fisher’s  z-transformation  was  0.59 
(N=932)  for  air-to-ground  and  0.03  (N=I004)  for  air-to-air  fixed 
gunnery. 

Applicability  of  Spearman-Brown  Formula. — Tho  reliability  figures 
presented  in  tables  11.1  and  11.2  aro,  of  course,  specific  to  tho  numbor 
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of  rounds  on  which  they  are  based.  A  determination  based  on  fewer 
rounds  fired  would  bo  expected  to  be  lower  and  ono  based  upon  moro 
rounds  would  bo  expected  to  bo  higher.  If  one  can  assume  that  the 
same  skills  wero  involved  throughout  tho  course  of  learning  fixed 
gunner}'  so  that  no  qualitative  change  occurred  in  the  task  measured, 
the  way  in  which  reliability  varies  with  tho  number  of  rounds  fired 
should  be  exactly  predicted  by  the  Spearman-Brown  formula.*1 

Table  11.1. — Reliability  of  400  roundi  of  air-to-ground  fixed  gunnery 

Classes  44-1-G  in  tho  Western  and  44-1-11  in  tho  Central  and  Eastern  Flying 

Training  Commands 


Transition  school 

JV 

Ml 

.su> 

rV 

r«* 

Western; 

Williams* . 

87 

8194 

32. 03 

a  si 

0  87 

Williams . 

£8 

91.37 

3a  00 

.31 

.87 

Eastern: 

Craltr . 

CO 

87.37 

29  13 

.22 

.33 

Do . 

<5 

M2.  51 

2130 

..00 

Spence . 

Cfl 

127.32 

41.49 

34 

.83 

Do . 

47 

97. 09 

3127 

.21 

.13 

Napier . 

vo 

Mi  03 

3fs.  04 

.50 

.*7 

Do . 

101 

9133 

38.02 

.42 

.SI 

Central: 

Foster . 

33 

mas 

48  29 

.49 

.88 

Uo . 

fl 

I3l.lt 

30  33 

.43 

.83 

A'oe . 

74 

121.  68 

44.04 

.82 

.7* 

Do . 

a  2 

13122 

47.03 

.84 

.78 

Moore . 

84 

123.11 

4132 

.33 

.30 

Do . 

32 

141 13 

43.03 

.49 

.64 

(-Average . 

932 

.SI 

■  Mean  of  cumulated  mission  scores. 

•SI)  <>f  cumulated  mission  scores. 

•  Odd-even  rellntiillty  of  four  ino-round  missions. 

•  Odd-even  reliability  corrected  for  double  leucth  (400  rounds)  by  the  Fj-eennsn-Drown  formula. 

•  Tbo  first  of  cncli  pair  Is  the  I’rs  l’-tO  section;  the  second  is  the  l’u»t  I’-tO  section. 


Table  11.2. — Reliability  of  1,200  roundi  of  air-to-air  fixed  gunnery 

Classes  44-1-G  in  the  Western  and  44-l-H  in  the  Eastern  and  Central  Flying 

Training  Commands 


Transition  school 

N 

Jt/» 

SD * 

fit 

ru* 

Western: 

Williams* . 

87 

Id  91 

57.03 

0  69 

ait 

Williams . . . 

38 

117.43 

3133 

.33 

.71 

Eastern: 

Crtly . 

89 

14.1(13 

62  93 

.34 

.70 

Do . . 

39 

104.38 

3A72 

.23 

.a 

Spence . 

64 

144.72 

81.73 

.  44 

.81 

Do . 

47 

103  77 

43.9* 

.  39 

.38 

Napier . 

93 

107.90 

44  34 

.31 

.47 

Do . 

101 

128.70 

84.83 

.42 

.a 

Central: 

Foster . 

33 

121.42 

49  28 

.84 

.a 

Do . 

90 

119  £4 

47.19 

.44 

.83 

Aloe . . . 

83 

114  91 

31  30 

.41 

.  S3 

Do . 

80 

123  38 

32  47 

.41 

.39 

Moore . 

84 

120  51 

38.00 

.34 

.72 

Do . 

K4 

1 19.  69 

43  30 

.44 

.61 

I-A VtfAgA r  T 

1,064 

.81 

•  Mean  of  cumulated  mission  scores. 

1  S' I*  of  cumulated  mission  scores. 

•  Odd-even  reliability  of  twelve  lOOround  misunn  scores.  ^  „ 

•  Odd-even  reliability  corrected  for  double  U  wth  <1,30  rounds)  by  the  Fpenrmsn-Drown  formula. 

•  The  Orst  of  c«ch  |>«lr  Is  ths  I’r*  F-40  section;  the  Rvoud  is  the  I’osi  F-40  Mvtloa. 
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"here  ru  Is  ths  reliability  of  the  lengthened  lest,  r’m  U  the  reliability  of  lb«  shorter  feet,  sad  .4  Is  tbs  hrtor 
by  which  lbs  shorter  test  Is  leoflbeoed. 
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Available  evidence  on  this  point  seems  to  indicate  that  tho  relation¬ 
ship  between  tho  reliability  of  fixed  gunnery  scores  and  tho  number 
of  rounds  involved  actually  docs  vary  in  the  way  predicted  by  tho 
Spearman-Brown  formula.  The  reliability  of  400  rounds  of  air-to- 
ground  firing  was  found  to  be  0.59  when  tho  coefficients  for  all  schools 
and  commands  were  combined  by  Fisher’s  z-transformation  technique. 
From  the  Spearman-Brown  formula,  it  was  predicted  that  tho  relia¬ 
bility  of  000  rounds  would  be  0.68.  For  265  students  in  Class  44-1-J 
in  Central  Flying  Training  Command  who  had  fired  600  rounds  of 
air-to-ground  gunnery,  the  reliability  was  found  to  be  0.69. 

In  a  study  at  Psychological  Research  Unit  No.  1,  based  on  523 
students  in  Class  43-F  in  the  Eastern  Flying  Training  Command,  it 
was  found  that  the  reliability  of  tho  822  rounds  fired  on  tho  last  2 
days  of  air-to-air  training  was  0.52.  On  the  basis  of  this  figure,  tho 
estimated  reliability  for  all  of  the  rounds  fired  during  training,  a  total 
of  1776,  should  be  0.70.  The  actual  reliability  of  tho  1,776  rounds 
was  found  to  be  0.69.  The  fact  that  theso  two  figures  agreo  closely 
indicates  that  the  assumptions  of  the  Spearman-Brown  formula  were 
satisfied  by  the  conditions  of  air-to-air  fixed  gunnery  learning  in  tho 
Training  Command.  The  fact  that,  ns  will  bo  shown,  tho  students 
continued  learning  and  improving  their  scores  throughout  training 
did  not  seem  to  affect  tho  estimates  of  reliability.** 

In  tho  study  by  the  Pilot  Project,  tho  reliability  of  1,200  rounds 
air-to-air  gunnery  was  0.G3.  On  the  basis  of  tliis  figure,  tho  reli¬ 
ability  of  1 ,776  rounds  was  predicted  to  bo  0.72.  Tho  agreement  of 
this  estiinnto  with  the  actual  figure  of  0.G9  is  well  within  tho  limits  of 
snmplmg  errors  to  be  expected  in  the  populations  of  tho  two  studies. 

To  summarize,  tho  reliability  of  fixed  gunnery  scores  varied  with 
tho  number  of  rounds  involved  in  tho  determination.  Tho  relation¬ 
ship  between  the  number  of  rounds  and  reliability  was  approximately 
what  the  Spearman-Brown  formula  predicted.  This  indicates  that 
scores  at  different  levels  of  the  learning  curve  arc  not  qualitatively 
different.  They  meosuro  tho  samo  bnsic  kind  of  skill,  though  of 
course  the  level  of  skill  depends  upon  tho  amount  of  training. 

Results  of  other  studies. — Reliabilities  in  tho  samo  general  range  as 
tlioso  found  in  the  studies  by  the  Pilot  Project  wero  reported  by  other 
organizations,  but  no  exact  comparisons  aro  possible  becauso  the 
numbers  of  rounds  involved  wero  not  reported. 

Psychological  Research  Unit  No.  1  reported  the  odd-even  reliability 
of  nir-to-air  fixed  gunnery  scores  for  three  classes  in  the  Eastern 
Flying  Training  Command  ns  follows:  (1)  Class  43-J,  for  459  students 
the  reliability  was  0.31  uncorrccted  and  0.47  corrected;  (2)  Class  43-K, 
for  403  students  tho  reliability  was  0:48  uncorrected  and  0.65  cor- 

w  Thb  Mtidy  wm  performed  by  M»J.  N.  E.  Miller,  Lt.  8.  M.  Roehal,  and  1.1.  W,  R.  Anjoff.  It  wai 
the  flrxt  InTcsilyntlon  by  aviation  psycholojlsu  of  fixed  gunnery  ecore*  In  the  AAF. 
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rccted;  mid  (3)  Class  44-1-A,  for  119  students  the  reliability  was  0.C3 
uncorrcctcd  and  0.77  corrected.** 

A  further  study  by  the  some  unit  reported  the  odd-even  reliabilities 
for  class  44-1-D  in  the  Eastern  Flying  Training  Command  by  transi¬ 
tion  training  school.  Following  are  the  odd-even  reliabilities: 


School  |  r'u  ru 


Cralf .  0.47  &  04 

Marian* .  ,M  .7* 

Napier .  .41  .00 

Sjwoco .  .44  .71 


The  Research  Section,  OfTico  of  the  Surgeon,  Headquarters  First 
Air  Force,  reported  the  following  odd-even  reliability  coefficients  for 
air-to-ground  fixed  gunnery  and  low-altitudc-aerial  fixed  gunnery  at 
tho  tactical  truining  level: 


Tho  research  section,  Headquarters  Second  Air  Force  reports  an 
odd-even  reliability  of  0.61  for  14  air-to-air  missions  of  at  least  100 
rounds  each.  Corrected  for  double  length,  this  becomes  0.70. 

Intcrcorrclation  of  Air-to-Air  and  Air-to-Ground  Fixed  Gunnery  Scores 

How  similar  are  the  skills  involved  in  air-to-air  and  air-to-ground 
fixed  gunnery?  If  tho  two  scores  measure  separate  skills,  it  may  bo 
desirablo  to  uso  them  os  separate  criteria;  if  they  measure  tho  snmo 
skills,  the  combined  score  is  all  that  need  be  used. 

The  correlation  was  calculated  between  the  mean  mission  scoro  for 
4  air-to-ground  missions,  and  tho  mean  mission  scoro  for  12  air-to-air 
missions.  One  exception  to  this  was  tho  data  for  class  44-1-G  in  tho 
Western  Flying  Training  Command  in  which  the  air-to-ground  mean 
mission  scoro  was  based  upon  six  missions. 

Means,  sigmas,  and  correlations  for  tho  classes  studied  in  each  com¬ 
mand  will  bo  found  in  table  11.3.  The  average  correlation,  ns  deter¬ 
mined  by  Fisher’s  z-trnnsformation  for  all  classes  studied  in  the  Eastern 
Flying  Training  Command  was  0.22  (N  =  1175)  and  for  all  classes 
studied  in  tho  Western  Flying  Training  Command  it  was  0.33 
(N=383). 

■  ThU  study  ns  pfffonnfd  by  Lt.  Wit*#  0.  Wf».b.  Pit  I.  HoUnd  X.  Johns  too  nod  8*t.  t»*mu*l  B. 
Ljtsly,  tod  tho  following  on*  by  Lteutcnut  Wtbb  »od  8«n«»ot  Johnston. 
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Table  11.3. — Correlation  between  air-to-ground  and  air-to-air  fixed  gunnery  tcoret 


CUt! 

N 

J4/i* 

Mi 

SA' 

8I)fi 

9 

Eastern  Flying  Training  Command: 

44-1  -X.  PreP-40 . 

201 

21.67 

8.71 

8.54 

8.32 

11.40 

9.91 

4.14 

203 

224 

622 

626 

.27 

44-1-1.  Post  P-40 . 

148 

31.01 

44-1-J.  Pro  and  Post  P-40  . . 

403 

27.  28 

10. 70 

44-1-K.  Pre  and  Post  PHO . 

V* 

21.13 

10.32 

614 

.11 

.22 

.37 

.38 

I-Avcrnpr  . . 

1175 

Western  Flying  Training  Command: 
41-1-0.  Pre  P-40  . 

87 

24.02 

13.89 

7.89 
7.40 
10. 14 

4.73 

4.73 

608 

7.66 

44-1-0.  Post  P-40  . 

58 

24.50 

13.80 

43  A,  Prc  and  Post  P-40 . 

110 

23.64 

15.02 

45  B  Pro  And  Post  P-40 . 

110 

23.29 

16.67 

12  76 

.14 

.33 

t- Average  . 

383 

•  The  subscript  |  Indicates  air-to-ground. 

•  The  subscript  2  Indicate!  air-to-air. 


In  order  to  obtain  an  estimation  of  the  causal  factors  mutually 
shared  by  the  two  types  of  fixed  gunnery,  the  correlations  were  cor¬ 
rected  for  attenuation.  This  correction  was  made  in  order  to  cstimato 
the  true  relationship  when  the  diluting  effects  of  chance  differences 
duo  to  the  unreliability  of  the  scores  had  been  removed.  The  cor¬ 
rected  correlations  were  0.3G  for  Eastern  Flying  Training  Command 
(N=1175)  and  0.54  for  Western  Flying  Training  Command  (N=383). 
Thoso  indicated  that  approximately  13  percent  and  29  percent, 
respectively,  of  the  causal  factors  in  the  two  fixed  gunnery  tasks 
wero  mutually  shared.  In  other  words,  87  percent  and  71  percent 
of  the  factors  in  the  two  tasks  were  not  shared.  In  the  light  of  theso 
findings,  it  seemed  advisable  to  use  the  two  gunnery  scores  as  separate 
criteria. 

Learning  in  Air-to-Air  and  Air-to-Ground  Fixed  Gunnery  Training 

The  amount  and  courso  of  learning  in  air-to-air  and  air-to-ground 
gunnery  were  determined  in  order  to  indicato  how  learning  must  bo 
taken  into  account  in  using  theso  scores  as  criteria  and  also  to  show 
whether  or  not  the  students  were  reaching  tho  point  of  diminishing 
returns  within  the  number  of  missions  used  in  training. 

The  learning  curve  for  each  typo  of  gunnery  training  was  obtained 
from  tho  mean  score  for  each  successive  mission.  It  was  assumed 
that  a  relatively  accurate  picturo  of  tho  learning  process  could  bo 
obtained  if  enough  cases  were  included  so  that  other  factors  would  bo 
randomized.  Table  11.4  presents  tho  means  by  mission  for  each 
command  and  for  all  commands  combined  for  air-to-ground  fixed 
gunnery.  Similar  data  aro  presented  in  table  11.5  for  air-to-air 
fixed  gunnery. 

It  can  be  seen  from  tho  data  presented  in  tables  11.4  and  11.5  that 
considerable  learning  occurred  in  each  typo  of  gunnery,  but  that  in 
air-to-ground  gunnery  there  wero  definito  unsystematic  differences 
in  the  learning  curves  for  successive  groups  of  students.  Most 
striking  was  the  difference  in  tho  learning  in  air-to-ground  gunnery 
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Table  11.4. — Ltnming  in  air-to-ground  fixed  gunnery 


Class  44-1-G  In  the  Western,  44-1-F  in  the  Eislem.  And  44-1-J  In  tho  Central 

Flying  Training  Cominnna 


Hundred  rounds 

Western 

Eastern 

Central 

All  combined 

N 

St* 

N 

St  i 

Tra  r-w 

Tost  P-40 

AT 

A/i 

AT 

St ' 

N 

M  i 

First . 

143 

19.8 

439 

139 

314 

21.0 

215 

20.0 

1,101 

19.  a 

Second . 

143 

711 

483 

212 

312 

21  3 

m 

313 

1.170 

24.0 

Third . 

143 

71 3 

479 

27  1 

311 

21.3 

VM 

39.0 

1,114 

27.0 

Fourth . 

143 

20.  3 

473 

29.9 

308 

23.  1 

173 

39.9 

l.  mi 

29.1 

Fifth . 

143 

23.1 

419 

37.9 

7J9 

14.4 

122 

41.1 

983 

34.0 

Slith . 

US 

30.3 

284 

39.7 

230 

33.7 

30 

4t.  4 

733 

131 

i  M  U  the  average  percentage  of  hlU. 


Table  11.5. — Learning  »'n  air-to-air  fixed  gunnery 

Class  44-l-G,  44-1-II  in  tho  Eastern  and  44-1-G,  44-1-J  in  the  Western  Flying 

Training  Commands  Combined 


Tlundrcd  rounds 

AT 

A/« 

SD 

Hundred  rounds 

.V 

Aft 

SD 

First . 

80! 

A  39 

7.83 

Eighth . 

4M 

11.04 

9.83 

Second . . . 

400 

8.83 

A  14 

Ninth . 

807 

1X08 

tan 

Third . 

842 

AGO 

121 

Tenth . 

404 

1123 

11.47 

471 

10.27 

9.13 

Eleventh . . . 

Ml 

13.11 

A93 

Fifth . 

809 

10.29 

9. 17 

Twelfth . 

401 

14.00 

II.M 

Sixth  . 

407 

11.78 

10.97 

Thirteenth . 

822 

14.47 

1L  77 

Seventh . 

831 

11.03 

9.38 

■  M  U  the  average  percentage  of  hlU. 


for  the  Pro  and  Post  P—10  sections  •*  of  class  44-1-J  in  Central  Flying 
Training  Command.  Since  the  number  of  students  in  each  doss  was  , 
limited  to  roughly  200  to  300  in  Central  and  Eastern  Flying  Training 
Command,  not  enough  cases  were  available  for  tho  analysis  of  tho 
variables  affecting  each  mission.  It  is  probable,  however,  that  tho 
most  accurate  approximation  of  the  “true”  gunnery  learning  curves 
is  obtained  by  basing  the  curve  on  as  large  o  samplo  as  possiblo  so  that 
uncontrolled  variables  aro  randomized.  Figures  11.1  and  11.2  present 
thoso  curves  for  air-to-ground  and  air-to-air  fixed  gunnery, 
respectively. 

As  can  bo  seen  from  theso  learning  curves  it  was  important,  if 
cither  air-to-ground  or  air-to-air  fixed  gunnery  scores  wero  to  bo  used 
as  criteria,  that  they  bo  based  upon  a  specific  number  of  missions 
flown.  Defining  a  training  mission  as  100  rounds,  each  successive 
mission  averago  was  higher  than  the  preceding  ono.  To  mako  scores 
for  all  students  coniparablo  they  all  had  to  bo  based  upon  tho  samo 
number  of  missions. 

«  Jo  the  light  of  finding*  presented  UU-r  In  thli  chapter  on  tho  effect  of  IMO  transition  mining  on  Used 
gunnery  Kotos,  It  *u  unlikely  that  the  difference!  found  here  could  U  due  to  one  group  haring  had  and 
the  other  not  having  had  the  P-40  training. 
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rif.n.1 

LEARNING  CURVE  FOR  AIR-TO-GROUND  FIXED  GUNNERY 

INMl  •*  IM  l»  T.H.  II  4| 


Sinco  tlio  learning  curvo  was  still  rising  approximately  as  steeply 
as  ever  at  tho  end  of  training,  it  could  bo  seen  that  the  amount  of 
firing  given  was  only  introductory  in  naturo,  with  only  a  fow,  if  any, 
students  ever  reaching  their  maximum  proficiency. 

A  similar  curvo  of  learning,  which  was  still  rising  steeply  at  the 
end  of  training,  was  secured  for  air-to-air  firing  on  523  students  in 
class  43-F  in  Eastern  Flying  Training  Command  by  Maj.  N.  E. 
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Miller,  Lt.  S.  M.  Roshal,  aiul  Lt.  W.  II.  Angoff  at  Psychological  Re¬ 
search  Unit  No.  1. 

In  a  study  made  by  the  Research  Section,  First  Air  Force,  of  19 
instructor  aerial  gunnery  learning  curves,  it  was  found  that  the  in¬ 
crease  in  proficiency  proceeds  at  a  fairly  uniform  rate  up  through  tho 
sixtieth  mission,  where  apparently  a  plateau  was  reached. 

VARIABLES  AFFECTING  FIXED  GUNNERY  SCORES M 
Variation  in  Training  Procedures 

The  study  of  gunnery  training  procedures  in  tho  three  flying  train¬ 
ing  commands  indicated  considerable  variation  at  both  tho  advanced 
and  transitional  training  levels. 

In  two  of  the  three  commands,  gunnery  training  at  tho  advanced 
training  level  consisted  only  of  ground-school  courses,  whilo  in  tho 
third  command,  two  hours  of  gunnery  missions  were  flown  using  gun 
cameras.  The  ground-school  curriculum  varied  both  in  extensiveness 
and  intensiveness  from  command  to  command  and  to  a  somewhat 
lesser  extent  between  advanced  schools  in  the  samo  command. 

Actual  air-to-air  and  air-to-ground  gunnery  practice  with  livo 
ammunition  took  place  only  during  the  transition  phnsc  of  training. 
Here  ngain  the  ground-school  curriculum  varied  from  command  to 
command  both  in  content  and  time  devoted. 

In  two  commands  the  students  were  sent  from  their  base  transition 
training  school  to  a  separate  gunnery  school  for  their  fixed  gunnery 
firing.  In  the  third  command  the  students  and  their  transition  train¬ 
ing  instructors  were  kept  together  for  the  fixed  gunnery  phaso  of 
training. 

In  one  command  every  mission  was  flown  with  a  gun  camera  in 
addition  to  livo  ammunition.  These  gun  camera  films  wero  then 
assessed  and  criticized  prior  to  the  student’s  flying  his  next  mission. 
In  a  second  command  only  nbout  onc-lmlf  of  tho  missions  wero  flown 
with  the  gun  camera  while  tho  third  flew  no  such  missions  because  of 
lack  of  assessing  equipment. 

In  two  of  the  commands  students  generally  flew  the  samo  plane  on 
successive  missions,  while  in  the  third  the  students  generally  flew 
different  planes. 

Variations  in  penalties  for  "fouls1''  wero  found  for  both  air-to- 
ground  and  air-to-air  fixed  gunnery  from  command  to  command. 

It  can  be  seen  from  this  brief  description  that  while  fixed  gunnery 
training  followed  tho  same  general  form  in  the  threo  flying  training 
commands,  differences  did  exist  in  procedure,  amount  and  typo  of 
training,  and  scoring.  Differences  also  occurred  in  procedures  und 
training  for  successive  classes  in  the  same  commund,  and  minor 

«  Work  in  this  section  wu  done  by  Mi].  Oleo  L.  neither*,  Lt.  WIIUuo  E.  Oilt,  Lt.  Rilpb  M.  Roil, 
kod  Sjt.  John  O  Oletfoo. 
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differences  existed  between  schools  in  the  same  class  and  command. 
In  the  light  of  these  differences,  it  seemed  necessary  to  analyzo  data 
separately  hy  command  and  class. 

A  moro  precis  description  of  these  variations  in  fixed  gunnery 
training  will  be  found  in  Appendix  11. 

Effect  of  10  Hours  P—10  Training 

Ono  half  of  each  class  was  given  fixed  gunnery  training  before 
receiving  P—10  transition  training;  for  the  other  half  the  order  was 
roversed. 

To  determine  tho  effect  of  this  P-40  training,  tho  data  used  in  the 
determination  of  tho  reliability  of  gunnery  scores  were  analyzed  by 
school  for  differences  between  Pro  and  Post  P-40  groups.  Tho 
statistical  reliability  of  tho  difference  between  mean  scores  was 
determined  by  uso  of  tho  critical  ratio.  Theso  comparisons  indicated 
that  tho  P-40  training  itself  did  not  affect  the  gunnery  scores.  Four¬ 
teen  comparisons  were  made.  In  7  cases  differences  wero  found  of  a 
magnitude  such  that  thero  wero  less  than  5  chances  in  100  that  a 
difference  as  largo  as  this  would  arise  by  chanco  in  comparablo  samples. 
Of  these,  four  cases  showed  tho  Pro  P—10  section  to  have  tho  higher 
mean  scoro  while  in  tho  remaining  threo  it  was  tho  Post  P—10  section. 
Sinco  tho  number  of  rounds  fired  was  held  constant  in  all  cases, 
learning  was  also  eliminated  ns  the  sourco  of  variance  in  mean  scores. 
Therefore  tho  variability  of  tho  differences  indicates  uncontrolled 
factors  nffecting  fixed  gunnery  scores. 

Tables  All.l  and  At  1.2,  in  tho  appendix,  present  these  comparisons 
for  air-to-ground  and  nir-to-nir  fixed  gunnery,  respectively. 

Data  prison  ted  by  Lt.  Wilsc  B.  Webb  and  Roland  E.  Johnston  of 
Psychological  Research  Unit  Xo.  1  also  indicated  no  consistent  trend 
in  Pro  and  Post  P—10  mean  scores.  In  their  study  of  air-to-air  firing 
in  Classes 44-1-1)  (N  =  4S7)  and4  t-l-D(X=647),itwasfoundthatthe 
mean  score  for  the  Pro  P-lOscction  was  significantly  higher  (CR=7.97) 
than  (ho  Post  P-10  section  in  Class  44-1-B  and  that  tho  reverse 
situation  held  in  Class  44-1-D  (CR  =  5.30). 

Turbulence,  a*  Measured  by  Instructors*  Ratings 

Tho  operation  of  uncontrolled  variables  had  been  suggested  by  tho 
results  of  tho  studios  of  learning  and  of  tho  effect  of  P—10  training. 
Both  students  and  instructors  agreed  that  turbulenco  was  ono  such 
factor.  They  further  agreed  that  air-to-ground  firing  was  more 
affected  hy  it  than  air-to-air.  becauso  turbulenco  was  most  sovero  at 
the  low  altitudes  where  air-to-ground  gunnery  was  fired. 

Tho  degree  of  turbulence  was  rated  during  each  mission,  on  a  two- 
point  scale,  by  tho  instructor  flying  with  each  flight  of  students  in 
Class  44-1-J  (Pro  P-tO),  Central  Flying  Trnining  Command.  Tho 
two  categories  wero:  “rough,"  defined  os  turbulence  judged  to  b« 
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greater  than  average,  and  “smooth"  meaning  less  than  averago 
turbulence. 

Mean  scores  by  mission  were  compared  for  tho  two  conditions  by 
use  of  the  critical  ratio.  These  data  are  presented  in  the  appendix  in 
table  All.3.  No  reliable  difference  (CR  =  75  based  on  1,198  cases), 
was  found  between  the  two  conditions  of  flight.  Therefore,  it  cannot 
be  said  that  turbulence  (as  rated  by  the  instructors)  had  any  effect  on 
air-to-ground  gunnery  scores.  It  should  bo  noted  that  this  does  not 
eliminate  turbulenco  as  a  variable  in  air-to-ground  gunnery.  It  only 
indicates  that  either  (1)  turbulence  may  not  have  been  an  important 
factor  or,  os  is  more  probable,  (2)  that  tho  instructor  ratings  did 
not  actually  differentiate  between  the  two  categories  of  turbulence. 

Time  of  Day 

Gunnery  instrrn  tors  agreed  that  different  times  of  day  wero  not 
equally  favorable  for  air-to-air  and  air-to-ground  gunnery.  The 
prevailing  opinion  was  that,  for  air-to-ground  gunnery,  early  morning 
and  late  afternoon  were  most  generally  favorable  sinco  tho  air  was  most 
likely  to  bo  smooth  at  theso  times.  For  air-to-air  gunnery  tho  best 
times  for  firing  were  considered  to  bo  near  tho  middle  of  tho  day,  when 
haze  and  glare  were  at  a  minimum.  Turbulenco  wos  not  judged  to 
be  an  important  factor  in  air-to-air  gunnery  sinco  it  was  seldom 
encountered  at  the  higher  altitudes  where  such  firing  was  done. 

Mean  scores  by  time  of  day,  corrected  for  learning,  were  computed 
for  both  air-to-ground  and  air-to-air  gunnery  using  time  of  take-off  as 
the  time  of  the  mission.  Tables  A  11.4  nnd  A  11.5,  in  the  appendix, 
present  theso  data  together  with  a  fuller  description  of  the  method  of 
tho  studies. 

From  the  air-to-ground  data  studied,  it  seemed  that  there  wero 
factors  associated  with  time  of  day  which  affected  these  fixed-gunnery 
scores.  However,  it  appeared  that  the  effect  varied  from  command  to 
command  nnd  from  class  to  class.  It  seemed  probable,  therefore,  that 
the  factors  themselves  differed  from  one  location  to  another,  at  least 
in  degree  if  not  in  kind.  To  determine  to  what  extent  this  was  true 
required  a  more  detailed  analysis  thnn  was  then  practicable. 

From  the  air-to-air  data  studied  it  appeared  that  those  fixed-gun¬ 
nery  scores  were  relatively  independent  of  variation  in  conditions 
associated  with  time  of  day. 

Wind  Direction  and  Velo  *y 

This  variable  affects  only  air-to-ground  gunnery  since,  in  air-to- 
air  gunnery,  both  the  tnrgct'nnd  the  attacking  plane  are  in  tho  same 
moving  air  mass.  As  was  stated  in  the  job  analysis  of  air-to-ground 
fixed  gunnery,  one  problem  is  the  correction  for  wind  drift.  Since 
all  missions  were  not  flown  under  the  same  wind  conditions,  the  diffi- 
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culty  of  the  task  of  air-to-ground  gunnery  might  vary  from  one  mission 
to  tho  next. 

Air-to-ground  fixed  gunnery  scores,  corrected  for  learning,  wero 
tabulated  by  wind  direction  (headwind,  crosswind,  and  tailwind)  and 
velocity  and  the  mean  score  for  each  direction  and  velocity  computed. 
Figure  11.3  presents  these  data  graphically  for  class  44— 1— J  in  tho 
Central  Flying  Training  Command.  A  more  detailed  description  of 
the  methods  used  in  this  study  is  given  in  tho  appendix,  and  Tablo 
AUG  presents  the  data  separately  for  tho  Pre  and  Post  P-40  sections 
of  the  class. 

As  figure  1 1.3  shows,  there  was  a  progressive  decline  in  percent  hits 
with  increasing  wind  velocity  from  any  direction.  Also,  it  appeared 
that  the  net  effect  of  tail  and  cross  winds  was  similar.  Missions  flown 
in  headwinds,  at  all  velocities  studied,  yielded  approximately  15  moro 
hits  per  100  rounds  fired  than  did  missions  flown  in  either  of  the  other 
two  wind  directions. 

A  comparison  of  the  wind  direction  and  velocity  data  for  the  two 
sections  of  the  class  shows  the  general  points  obtained  from  the  com¬ 
bined  curve  held  true.  In  each  section,  there  was  a  decline  in  percent 
hits  with  increased  wind  velocity,  and  the  scores  obtained  while  flying 
into  a  headwind  were  higher  than  those  obtained  while  flying  in  either 
of  the  other  two  wind  directions;  however,  neither  the  rate  of  dcclino 
in  hits  with  increasing  wind  velocity,  nor  the  relative  differences 
between  wind  directions  remained  constant.  This  indicated  the  inter¬ 
action  of  uncontrolled  variables  masking  the  true  picture  of  the  effect 
of  tho  wind. 

The  true  trend  was  probably  most  closely  approached  in  tho  com¬ 
bined  data  since  the  larger  number  of  eases  increased  the  likelihood  of 
other  variables  being  more  completely  randomized. 

Correction  oj  Air-to-Ground  Scores  jor  the  Ejjccl  oj  Wind  Direction 
and  Velocity.—"  Although  it  was  true  that  the  general  trend  of  effects 
of  wind  direction  and  velocity  were  similar  in  the  two  sections  of 
class  -1*1— I-J,  there  were  considerable  variations  in  absolute  values. 
This  fact  made  it  seem  less  likely  that  any  correction  for  wind  con¬ 
ditions  would  materially  improve  the  reliability  of  the  gunnery  scores. 
However,  since  this  variable  was  the  best  defined  and  most  accurately 
measured  of  the  several  known  variables,  it  was  decided  to  attempt 
the  correct  ion  of  the  gunnery  scores  for  the  effect  of  that  factor. 
Should  no  improvement  in  the  reliability  of  the  scores  he  obtained  with 
this  correction,  then  certainly  no  improvement  could  he  expected  ns  a 
result  of  correcting  for  the  less  well  defined  and  measured  variables. 

Using  the  data  for  the  Pre  P—10  section  of  class  14-l-J,  a  set  of 
conversion  tables  was  made  to  correct  individual  scores  obtained 
while  flying  in  any  given  wind  direction  ami  velocity  to  the  scores  that 
would  he  expected  had  the  mission  been  flown  in  the  optimum  head¬ 
wind.  These  conversions  were  equal  to  the  actual  difference  ill 
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percent  hits  between  the  expected  score  for  any  given  velocity  and 
direction  of  wind  and  the  optimum  headwind. 

The  scores  made  by  individual  students  during  the  Post  P-40 
section  of  this  class  were  corrected  for  the  effect  of  wind  direction  and 
velocity  by  using  the  conversion  tables  based  on  the  Pre  P-40  section. 
If  wind  direction  and  velocity  were  stnhlc  variables  within  each  day  of 
missions  in  air-to-ground  fixed  gunnery,  the  reliability  of  the  raw 
scores  should  be  spuriously  high  because  of  th?  correlated  factor. 
Correction  to  eliminate  effect  of  wind  would  therefore  yield  a  lower 
reliability  coefficient.  Such  proved  to  be  the  case.  The  reliability 
of  the  corrected  scores  was  only  0.47,  while  the  reliability  of  the  raw 
scores  was  0.53.M 

Since  no  greater  change  in  results  could  be  expected  in  correcting 
for  other  such  correlated  variables  than  was  found  above,  it  seemed 
impractical  to  attempt  to  reduce  the  cluss-to-clnss  variations  by 
computing  corrections  for  them.  All  data,  which  had  been  studied, 
indicated  that  the  variables  afTeeting  fixed-gunnery  performance 
varied  from  place  to  place  and  probably  from  season  t  o  season.  There¬ 
fore,  the  best  eontrol  of  them  was  to  analyse  the  data  separately  by 
class  and  command.  The  most  effective  way  of  achieving  this  control 
was  to  convert  the  scores  for  each  class  and  command  intostniuiard 
scores  and  to  use  these  standard  scores  in  further  analysis. 

% 

GENERAL  CONCLUSIONS  REGARDING  TIIK  PRECAUTIONS 

TO  HE  FOLLOWED  IN  HANDLING  OF  FIXED  GUNNERY 
SCORES  V 

Reliability 

Provided  a  sufficient  number  of  rounds  is  involved,  the  reliability 
of  fixed-gunnery  scores  was  satisfactorily  high.  Anyone  using  this 
type  of  Training  Command  fixed-gunnery  scores  in  a  study  could  \w 
reasonably  certain  that,  for  any  class  involved,  the  reliability  of  400 
rounds  of  air-to-ground  firing  would  be  approximately  0.50,  and  that 
of  1,200  rounds  of  air-to-air  firing  would  be  approximately  0.03. 
Since  the  reliability  varied  with  the  number  of  rounds  in  approximately 
the  manner  predicted  by  the  Spearman-Brown  formula,  it  was  im¬ 
portant  to  consider  the  number  of  rounds  on  which  the  reliability 
was  based  in  evaluating  results. 

Learning 

The  learning  curves  for  l>oth  air-to-ground  and  air-to-air  fixed 
gunnery  arc  so  steep,  with  no  indication  of  a  plateau  being  readied 
within  the  limits  of  the  training  outlined  here,  that  it  is  important 

•  Til>k>  All. 7,  In  thf  ipprivlli,  pfr.vnU  th***  data  mof*  compkMf.  In  ronnrctlvn  »llh  Ihl*  l»N»  »ll 
bt  found  •  nior«*  curoid*!*  ion  of  th*  m*tho«l  of  maklnf  th*-**  ronr*  Ilona. 

•’  Work  In  thl*  vr-tlon  *u  don*  by  MaJ.  OI*n  L.  !l*«(l<*r»,  1.1.  William  K.  (Jail,  LI.  Ka!|>h  M.  Hurt, 
and  Sgt.  John  O.  (Jkajon. 
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to  control  this  factor  in  tho  use  of  gunnery  data.  In  order  to  control 
learning,  data  for  each  student  to  bo  used  in  a  study  must  bo  based  on 
tho  saino  number  of  rounds  fired  during  tho  samo  stago  of  learning. 


P-10  Training 

|*  It  appears  reasonably  certain  that  tho  10  hours  of  P-40  Transition 
training  received  by  one-half  of  each  class  prior  to  gunnery  training 
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lmd  no  appreciable  effect  on  the  gunnery  scores  obtained.  Therefore, 
tho  Pro  and  Post  P-40  sections  of  any  given  class  can  bo  combined 
•when  other  factors  remain  constant.  Since  the  two  subsections  of  tho 
class  are  subjected  to  somewhat  different  conditiono,  it  is  well  to 
analyzo  them  separately  when  a  sufficient  number  of  cases  aro  avail* 
able  in  each. 

Other  Variables 

Tho  effects  of  such  variables  as  turbulence,  timo  of  day,  weather, 
etc.,  either  wero  not  accurately  mcasurablo  or  wero  so  variable  in  effect 
from  one  class  or  location  to  another  that  it  was  impossible  to  make 
any  simplo  correction  for  their  effects.  Therefore,  it  was  advisablo  to 
handle  data  including  moro  than  ono  class  or  command  in  ono  of  tho 
two  following  manners:  either  tho  computations  should  bo  carried  out 
separately  for  each  group  (class  or  command)  and  tho  results  com¬ 
bined,  or  scores  of  individual  students  should  bo  converted  to  normal¬ 
ized  scores  by  class  or  command  beforo  analyzing  tho  data. 

Another  variable  which  was  present  in  tho  gunnery  training  situa¬ 
tion,  but  which  was  not  subject  to  accurato  measurement  was  tho 
piano  flown  by  the  student.  A  preliminary  analysis,  not  reported  in 
detail  here,  showed  that  thero  was  a  relationship  between  tho  piano 
flown  and  tho  gunnery  scores  obtained  by  tho  students  flying  it.  It 
was  difficult  to  work  out  any  systematic  correction  for  this  factor 
bccauso  tho  effect  of  tho  samo  piano  varied  from  timo  to  timo  do- 
pending  upon  (1)  the  state  of  maintenance,  and  (2)  tho  harmonization 
of  tho  sight  and  gun.  Furthermore,  tho  number  indicating  tho  piano 
might  chango  either  during  or  between  classes,  sinco  each  field  had 
only  a  limited  number  of  piano  numbers  assigned  to  it  and  replacement 
planes  were  given  the  same  number  as  one  previously  assigned  to  tho 
field.  In  any  study  of  fixed  gunnery,  it  should  bo  stated  whether  or 
not  each  student  flies  the  same  or  different  ships  on  successive  missions 
in  order  to  indicate  whether  or  not  possiblo  piano  differences  havo 
added  to  or  subtracted  from  the  apparent  reliability  of  tho  data. 

FURTHER  EVALUATION  OF  FIXED  GUNNERY  SCORES  * 

Ability  of  Instructor  Ratings  of  Pilot  Proficiency  in  Advanced  Training 
to  Predict  Subsequent  Fixed  Cunnery  Scores 

In  order  to  evaluate  fixed  gunnery  scores  moro  accurately  as  a 
possiblo  criterion  of  pilot  proficiency,  instructors’  ratings  of  students 
flying  proficiency  wero  correlated  with  tho  students’  subsequent 
gunnery  scores. 

During  tho  final  week  of  advanced  singlc-cngino  training  for  class 
45-B  at  AIoo  Army  Air  Field,  each  of  tho  174  students  wero  rated  in 
flying  proficiency  by  his  flying  instructor.  Tho  instructors  wero  asked 

«  Work  lor  thU  «ocUon  *u  iIom  by  L(.  WUIItm  X.  Q»lt  iml  ffl-  John  O.  OlrtM. 


255 


to  rate  their  students  on  a  quartile  rating  basis,  using  all  of  their 
previous  students  ns  tho  standard  of  judgment.  These  ratings  wero 
then  assigned  numerical  values  of  from  1  to  4,  with  4  including  the 
top  quarter.  Of  tho  174  students  rated,  58  were  assigned  to  and 
completed  fixed  gunnery  training.  The  larger  proportion  of  these 
students  had  been  ruled  in  the  best  two  quarters  of  flying  ability. 
None  of  the  students  assigned  to  gunnery  training  was  rated  in  the 
poorest  quarter.  Product-moment  correlation  coefficients  wero  com¬ 
puted  between  instructor  ratings  at  the  Advanced  school  and  air- 
to-air  and  air-to-ground  fixed  gunnery  scores  for  the  58  students  as¬ 
signed  to  gunnery  training.  The  air-to-ground  gunnery  score  used  for 
each  student  was  his  average  percent  hits  for  four  100-round  missions 
and  the  air-to-air  score  used  was  the  overage  percent  hits  for  twelve 
100-round  missions. 

The  instructor  ratings  correlated  0.35  M  with  both  the  air-to-ground 
scores  and  the  air-to-air  scores.  In  evaluating  these  results  it  is 
necessary  to  remember  that  the  group  of  students  used  in  this  study 
represent  a  very  restricted  range  of  ability;  a  restriction  made  even 
more  severe  by  tho  final  selection  in  Advanced  schools  of  only  those 
men  judged  to  be  tho  best  potential  gunnery  students.  Tho  correla¬ 
tions,  while  not  high,  gave  added  support  to  tho  professional  judgment 
of  gunnery-training  personnel  that  ability  in  fixed  gunnery  was  a  good 
criterion  of  pilot  proficiency. 

Ability  of  Fixed  Gunnery  Scores  in  the  Training  Command  to  Predict 
Those  in  the  First  Fighter  Command 

The  air-to-air  and  air-to-ground  fixed  gunnery  scores,  separately 
and  combined,  in  the  Training  Command  were  correlated  with  the 
corresponding  fixed  gunnery  scores  in  tho  First  Fighter  Commnnd. 
This  was  done  to  determine  the  degree  of  relationship  between  the 
task  of  fixed  gunnery  in  the  slower  AT-0  plane  used  in  tho  Training 
Command  and  the  faster  P-47  used  in  the  Fighter  Commnnd. 

The  sample  of  Training  Command  scores  enme  from  the  same  1,308 
students  described  in  the  following  section  of  this  chapter.  Of  these 
1,308  students,  only  322  were  eventually  assigned  to  the  First  Fighter 
Command  and  fixed  gunnery  records  were  available  for  only  179  of 
these.  The  Training  Command  gunnery  scores  used  in  this  study 
wero  described  in  the  preceding  section.  The  Fighter  Commnnd 
6eores  used  were  standard  scores  based  on  the  mean  and  sigma  of  each 
class  and  school.  They  were  supplied  by  the  Research  Section, 
Office  of  the  Surgeon,  First  Air  Force. 

Table  11.0  presents  the  intercorrelations  of  the  air-to-air  and  n'.r- 
to-ground  fixed  gunnery  scores  in  the  two  stages  of  training.  The 
correlation  between  the  combined  scores  is  0.38.7* 

XII  In iKf  thr*r <lot» m<-f* fully. 
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It  can  be  seen  that  fixed  gunner}*  scores  in  the  slower,  lighter  planes 
used  in  the  Training  Command  did  predict  performance  in  tho  faster, 
heavier  ones  used  in  the  First  Fighter  Command,  but  that  tho  pre¬ 
diction  was  far  from  perfect  even  when  corrected  for  tho  attenuation 
produced  by  the  fact  that  the  s  ores  in  each  command  wero  not 
perfectly  reliable.  The  relativel)  low  correlations  indicate  that  tho 
tasks  were  quite  a  bit  different  at  these  two  levels  of  training. 

Table  11.0. — Correlation  bet  tree  n  fixed  gunnery  scores  in  the  training  command  and 
those  in  the  First  Fighter  Command  based  on  170  students 

First  Fighter  Command  * 


Air-to-ground 

Air-to-air 

M 

TRAININO  COMMAND  * 

A  lr-to-cround _ _ _ _ _ _ _  .. 

0.13  (0.31)1 
li  (0.31) 

30.  KT 

10.00 

0.30  (IUI) 
.34  (0.U) 
51.73 

11.00 

4.  ft 

A  Of 

■  Plnple-dlRll  normallrcd  KMirrs,  Mnrlc-enplnf  Imnsltlon  training  In  lha  AT-4. 

>  Standard  scurvs,  sliiKl.-t'licinr  tactical  tni  ling  In  tbc  l’-47. 

>  Com  latlonj  In  pari'inhrv  i  arc  rurrrcti-d  (nr  attenuation  In  or>hr  to  MtlmaU  tho  drgrro  of  relationship 
uhlcb  would  be  rspevn-d  if  perfect ly  roll  iblc  mcuuret  could  by  secured  Id  each  command. 

It  will  bo  remembered  that  the  two  types  of  gunnery,  air-to-air  and 
air-to-ground,  correlated  with  each  other  only  0.22  in  Eastern  Flying 
Training  Command,  which  was  the  source  of  all  of  tho  students  sent 
to  tho  First  Fighter  Command.  Even  after  correction  for  attenua¬ 
tion,  this  correlation  was  only  0.36.  This  low  valuo  indicates  that 
the  skills  involved  in  these  two  types  of  gunnery  wero  considerably 
different.  From  this  it  might  be  expected  that  the  correlation  bctwcon 
tho  same  type  of  gunnery  in  tho  two  commands  would  bo  higher  than 
that  between  different  types:  For  example,  one  would  expect  the  cor¬ 
relation  between  Training  Command  air-to-air  and  Fighter  Command 
air-to-air  gunnery  to  be  higher  than  that  between  Training  Command 
nir-to-air  and  Fighter  Command  air-to-ground  gunnery.  Table  11.6 
shows  that  this  was  not  the  case;  tho  correlations  between  tho  differ¬ 
ent  types  arc  us  high  ns  thoso  between  the  aamo  types.  None  of  tho 
elements  of  skill  which  were  general  enough  to  apply  to  both  tho  slower, 
lighter  planes  in  the  Training  Command  ami  tho  faster,  heavier  oneo 
in  the  Fighter  Command  were  specific  to  either  air-to-air  or  air-to- 
ground  gunnery. 

Ability  of  Classification  Test  Scores  to  Predict  Fixed  Cunnery  Per- 
fot  mance  Tl 

Tho  individual  classification  tests  were  validated  against  gunnciy 
scores  to  determine  tho  extent  to  which  these  tests,  administered  prior 
to  any  pilot  training,  could  predict  fixed  guiuiery  ability  approximately 
one  year  later. 

y  n  Work  In  thli  section  wu  don*  by  S«t.  John  0.  Olrvvm  and  Chart*  T.  Omhrruon; rlaulflcatlo* 
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Fixed  gunnery  scores  were  obtained  for  1,308  students  in  classes 
44-1-1,  44-1-J,  44-1-K,  and  45-A  in  the  Eastern  Flying  Training 
Command.  Two  scores  were  obtained  for  each  student:  (1)  The 
average  percent  hits  for  the  first  four  100-round  air-to-ground  missions, 
and  (2)  the  average  percent  hits  for  the  first  twelve  100-round  air-to-air 
missions.  These  scores  wero  normalized  and  transformed  into 
single-digit  scores  by  the  following  method.  Distributions  of  the 
air-to-ground  and  air-to-air  fixed  gunnery  scores  wero  made  separately 
by  class,  and  broken  into  nine  class  intervals  containing  respectively 
4,  7,  12,  17,  20,  17,  12,  7,  and  4  percent  of  the  students'  scores.  A 
single  digit  scoro  was  substituted  for  the  actual  percent  hits  in  each 
class  interval,  1  being  assigned  to  the  lowest  4  percent,  2  to  the 
next  higher  7  percent,  and  so  on  until  9  was  assigned  to  the  top 
4  percent.  The  single-digitcd,  normalized,  air-to-air  and  air-to- 
ground  scores  were  averaged  to  yield  a  third  score  reflecting  the 
student's  over-all  fixed  gunnery  ability.  All  fractions  in  these  aver¬ 
ages  wero  0.5  and  wero  rounded  to  the  next  lower  whole  number. 
Thus,  the  combined  scoro  was  also  a  single-digit  number. 

These  tlirco  scores  wero  used  separately  as  criteria  of  gunnery  pro¬ 
ficiency  and  the  classification  testa  validated  against  them.  Tablo 
11.7  presents  the  correlations  of  tho  tests  in  classification  batteries 
3  and  4,  and  of  tho  three  stanincs  with  the  three  criteria  of  gunnery  , 
proficiency. 

It  can  be  seen  that  each  of  tho  three  stanines,  determined  prior  to 
tho  beginning  of  flying  training,  predict  gunnery  performance  at  tho 
end  of  training.  The  pilot  stanino  yields  tho  best  prediction.  While 
the  correlation  is  relatively  low,  it  is  of  a  sizo  which  would  be  expected 
to  occur  by  chance  less  than  1  time  in  10,000.  In  evaluating  theso 
correlations,  it  should  be  noted  that  tho  range  of  talent  is  markedly 
restricted  hy  tho  timo  tho  students  reach  gunnery  training.  No 
corrections  for  restriction  of  rango  were  made. 

Tho  fact  of  having  had  flying  experience  prior  to  starting  military 
flying  training,  though  highly  related  to  success  in  primary  flight 
training,  appears  to  have  no  relation  to  proficiency  nt  this  advanced 
stage  of  training. 

Theso  tests  which  best  predict  air-to-ground  fixed  gunnery  scores 
also  seem  to  bo  tho  ones  which  best  predict  the  air-to-air  gunnery 
scores,  within  tho  limits  of  expected  sampling  variation.  In  general, 
tho  tests  which  best  predict  pass-fail  in  primary  flight  training  also 
yield  tho  best  prediction  of  tho  combined  fixed  gunnery  scoro.  Two 
possible  exceptions  to  this  generalisation  are  the  general  information 
and  rudder-control  tests,  which  seem  to  be  less  related  to  gunnery 
performance  than  to  success  in  primary-flight  school. 

The  main  results  of  this  study  arc  confirmed  by  those  of  such  other 
investigations  as  have  been  made  in  this  area.  As  is  shown  in  table 
11.7,  Psychological  Research  Unit  No.  1  secured  a  correlation  of  0.18 
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Table  11.7. — Correlation*  of  all  elnttiftcalion  lent*  and  itanintt  with  three  criteria 

of  gunnery  proficiency 


Number  of  Ctuvr.  Itattcry  3,  310;  Battery  4,  081;  Total  1,000 
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•  Primary  pass-fad  validity  eocUlricnU  lor  variables  I  throuyh  23  board  on  8^88  students  In  daises  49-0 
throuph  4X-I .  and  for  testa  23  thrmich  2D  based  on  «,2I3  student*  In  clasi  41-E.  Correlations  cotupulsd  by 
Statistical  Unit,  Psychological  Section,  Ollleo  of  the  Surgeon,  llq.  A  A  V  Tralnlnr  Command. 

•  Correlations  with  olr-to-nlr  score*  for  323  students  from  class  43-F  of  Eastern  I'lyln*  Training  Command 
reported  by  MaJ.  N.|K.  Miller,  LL  S.  M.  Roshal,  and  LI.  W.  II.  Angotl from  rsycholoflcol  lisasarth  Unit 
No.  1. 

•  Corrected  for  restriction  la  rant*  produced  by  fact  that  students  with  low  sUnlnes  were  not  sent  to  pilot 
training. 

•  Referring  to  slanlnes  and  test  soores  of  students  Inrolved  In  conelstions  with  three  altertn  of  funosry 
profldancy. 

between  tho  averago  percent  hits  on  1,800  rounds  of  air-to-air  fixed 
gunnery  and  tho  pilot  stanino  for  523  students  from  an  earlier  class, 
43-F.  Sinco  adding  credit  to  tho  stanino  for  having  had  flying  experi¬ 
ence  beforo  starting  military  flying  training  did  not  improvo  tho 
prediction,  it  may  bo  inferred  that  such  experience  was  no  help  by  tho 
timo  tho  students  reached  fixed  gunnery  training  Tho  individual 
tests  which  wero  validated  also  yielded  coefficients  similar  to  thoso 
secured  by  tho  Pilot  Project.  Finally,  the  Research  Section,  Offico  of 
tho  Surgeon,  Hq.  Second  Air  Force,  has  correlated  the  pilot  stanino  of 
427  students  with  tho  averago  percent  of  hits  on  14  air-to-air  missions 
of  at  least  100  rounds  each.  Tho  correlation  at  this  later  level  of 
tactical  training  was  0.14,  again  in  tho  saino  range.  Furthermore, 
adding  credit  to  the  stanino  for  flying  experience  before  starting  mili¬ 
tary  training  did  not  improve  the  prediction,  it  yielded  a  correlation  of 
only  0.13,  again  confirming  earlier  results. 
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PROBLEM  FOR  FUTURE  RESEARCH 

The  most  important  problem  for  further  research  is  beliovcd  to  be 
determining  how  much  different  amounts  of  fixed  gunnery  training  on 
Iho  lower-powered  AT-G  will  help  the  student  in  the  liighcr-powered 
planes  used  in  combat.  The  learning  curves  presented  in  the  first 
part  of  this  chapter  were  still  going  up  about  as  steeply  ns  over  at 
the  end  of  the  amount  of  practice  given  in  the  Training  Command. 
Apparently  tho  students  did  not  approach  their  limit  of  learning. 
Although  it  is  quite  certain  that  with  moro  practico  the  students  would 
hr vc  become  considerably  more  accurate  in  firing  with  the  AT-G,  it 
is  by  no  means  certain  that  tliis  would  have  helped  them  in  learning 
to  fire  with  higher  powered  tactical  planes.  In  fact,  it  is  even  possible 
that  the  training  on  the  slower  and  lighter  AT-G  taught  the  students 
habits  which  interfered  with  gunnery  in  tho  faster,  heavier  tactical 
planes. 

Tho  correlations  lie  tween  tho  gunnery  scores  in  tho  Training  Com¬ 
mand  and  thoso  in  tho  First  Fighter  Command  are  low  enough  (even 
when  corrected  for  tho  attenuation  produced  by  tho  unreliability  of 
tho  measures)  to  indicate  that  tho  two  types  of  firing  are  far  from 
identical  tasks.  Laboratory  experiments  and  practical  experience 
indicato  that  it  is  unsafo  to  make  a  priori  assumptions  concerning  tho 
typo  of  transfer  which  will  occur  in  complex  situations  of  this  kind. 
Tho  only  way  to  determine  tho  most  efficient  distribution  of  fixed 
gunnery  training  is  by  an  experimental  investigation  of  the  amount 
of  transfer  to  tactical  planes  which  is  produced  by  different  amounts 
of  training  in  the  AT-G.  Some  students  should  bo  sent  to  tho  higher 
powered  tactical  ships  with  no  gunnery  training  in  tho  AT-6,  others 
should  Iks  sent  with  considerably  moro  training  than  is  now  given, 
and  still  others  should  l»o  given  various  intermediate  amounts  of 
practico  in  tho  Training  Command.  Tho  groups  receiving  different 
amounts  of  fixed  gunnery  training  in  tho  AT-0  should  not  bo  selected 
by  chanco;  tho  students  in  them  should  bo  matched  on  tho  basis  of 
their  flying  proficiency  in  advanced  training.  When  theso  students 
aro  sent  to  the  Air  Forces  an  equal  number  should  be  assigned  from 
each  group  to  each  instructor  or  squadron.  Then  tho  curves  of  learn¬ 
ing  in  tho  Air  Forces  should  bo  examined  for  each  group  to  discover 
differences  in  initial  performance  and  whether  or  not  these  differences 
persist  throughout  tactical  training. 

SUMMARY 

These  studies  were  undertaken  to  dotcrinino  the  suitability  of  fixed 
gunnery  scores  os  objective  measures  of  pilot  proficiency  at  the 
single-engine  transition  training  level. 

It  was  found  from  the  job  analysis  of  air-to-ground  and  air-to-air 


fixed  gunnery,  that  considerable  flying  skill  was  required  to  fly  tho 
plane  in  such  a  way  that  the  bullets  from  its  guns  would  hit  tho  target. 

Since  these  tasks  did  include  important  elements  of  flying  skill,  tho 
next  step  in  evaluating  fixed  gunnery  scores  as  an  objective  mensuro 
was  to  determine  their  reliability  and  other  statistical  characteristics. 
Tho  following  facts  were  determined: 

(а)  The  odd-even  mission  reliability  was  0.03  (X  =  1004)  for  1,200 
rounds  fired  in  air-to-air  fixed  gunnery  and  0.59  (X=032)  for  400 
rounds  fired  in  air-to-groind  fixed  gunnery.  These  reliability  coeffi¬ 
cients  were  satisfactorily  high  to  warrant  the  use  of  gunnery  scores  os 
criterion  data.  Tho  reliability  of  these  scores  varied  with  the  num¬ 
ber  of  rounds  on  which  they  wero  based,  and  the  Spearman-Brown 
formula  was  found  to  give  accurate  predictions  of  this  relationship. 

(б)  Tho  mtercorrclation  of  air-to-air  and  air-to-ground  fixed  gun¬ 
nery  scores  was  relatively  low  (0.22  based  on  1,175  cases  in  the  Eastern 
Flying  Training  Command,  0.33  based  on  383  eases  in  tho  Western 
Flying  Training  Command)  so  that  it  seemed  advisablo  to  uso  tho 
two  types  of  scores  as  separata  criteria. 

(5)  The  learning  curves  for  both  air-to-air  and  air-to-ground  fixed 
gunnery  wero  still  rising  rapidly  at  the  end  of  training.  This  indi¬ 
cated  that  the  limit  of  learning  had  not  been  reaehed  during  the  period 
allotted  to  training. 

Further  study  of  fixed  gunnery  data  indicated  several  possiblo 
uncontrolled  variables  including:  variations  in  training  procedures, 
turbulence,  time  of  day,  plane  flown,  and  wind  direction  and  velocity. 
Since  tho  exact  amount  of  effect  produced  by  each  of  these  variables 
was  not  easily  determined,  the  students’  individual  scores  could  not 
bo  easily  corrected  for  their  effects.  It  was  therefore  necessary  to 
control  for  these  variables  by  analyzing  all  data  separately  by  class 
and  command. 

Recognizing  the  above-listed  characteristics  ol  fixed  gunnery  scores 
and  taking  tho  proper  precautions  for  their  control,  it  was  found  that 
subjcctivo  ratings  of  flying  ability,  made  by  instructors  at  tho  ad¬ 
vanced  stage  of  training,  correlated  0.35  with  both  air-to-air  and  air- 
to-ground  gunnery  scores  in  tho  transition  stage.  Furthermore,  tho 
combined  air-to-air  and  air-to-ground  fixed  gunnery  score  in  tho 
Training  Command  correlated  0.38  with  a  similar  score  obtained  in 
tho  First  Fighter  Command.  The  correlation  between  different  types 
of  gunnery  in  tho  two  commands  (i.  c.,  air-to-ground  in  Training 
Command  v.  air-to-air  in  Fighter  Command)  was  ns  high  as  tho 
correlation  between  tho  same  type.  This  indicated  that  none  of 
the  elements  of  skill  which  were  general  enough  to  apply  to  both  tho 
slower,  lighter  planes  in  tho  Training  Command  and  tho  faster, 
heavier  ones  in  the  Air  Forco  were  specific  to  either  air-to-air  or 
air-to-ground  gunnery. 


261 


Finally,  it  was  found  that  those  tests  in  the  classification  battery 
which  had  the  highest  validity  as  measured  by  the  pass-fail  criterion 
in  primary  training,  also  tended  to  have  tho  highest  correlations  with 
fixed  gunnery  scores  in  transition  training. 

The  Pilot  Project  recommended  that  an  experiment  bo  conducted 
to  determine  how  much  different  amounts  of  fixed  gunnery  training 
on  the  lower  powered  AT-6  will  help  students  in  the  higher  powered 
planes  used  in  combat. 


CHAPTER  TWELVE _ 

Printed  Tests  of  Flying 
Information 

S/Sgt.  Irving  Robbins  and  Sgt.  Robert  Levine71 


INTRODUCTION 

Reports  of  Aircrew  Evaluation  and  Research  Detachments  sent 
overseas  by  tho  Office  of  tho  Air  Surgeon  and  information  gained 
from  interviews  with  experts  recently  returned  from  combat  and  as¬ 
signed  to  organizations  such  as  tho  AAF  Tactical  Air  Center  and  tho 
Proving  Ground  Command  emphasized  tho  fact  that  tho  task  of  a 
successful  combat  pilot  involved  much  more  than  tho  motor  and  per¬ 
ceptual  skdls  required  to  handle  a  piano.  Tho  pilot  had  to  havo  a 
thorough,  practical  knowledge  of  the  aerodynamics  and  flying  char¬ 
acteristics  of  his  airplane  in  order  to  get  maximum  performanco  under 
combat  conditions.  Since  he  was  responsible  for  seeing  that  tho  crow 
maintained  and  used  the  plane’s  equipment  properly  and  sinco  enemy 
fire  created  sudden  emergencies  in  tho  air,  ho  had  to  havo  a  compre¬ 
hensive  understanding  of  what  his  piano  and  its  equipment  were  do- 
signed  to  do  and  how  they  were  affected  by  unusual  conditions  and 
emergency  situations. 

One  of  tho  most  important  requirements  for  airplane  commanders 
and  lead-crew  pilots  was  a  wido  background  of  practical  knowledge  to 
serve  as  a  basis  for  good  judgment  in  making  decisions  bearing  on  the 
success  of  tho  mission  and  tho  safety  of  tho  personnel  involved.  For 
example,  the  pilot  had  to  balanco  tho  probabilities  of  icing  and  head¬ 
winds  at  certain  altitudes  against  tho  truo  air  speed  and  rato  of  fuol 
consumption.  Though  ho  received  advico  from  his  navigator  and 
engineer,  the  final  decision  rested  with  him.  Having  tho  proper  in¬ 
formation  may  not  insure  sound  judgment,  but  without  a  certain 
minimum  of  knowledge  good  judgment  is  impossible. 

Tho  printed  tests  of  flying  information  were  designed  for  two  pri¬ 
mary  purposes: 

(1)  To  select  pilots  for  special  assignments,  such  os  lead-crew  or  in¬ 
structor  training,  on  tho  basis  of  their  achievement  in  advanced 
stages  of  training. 

(2)  To  diagnose  tho  strengths  and  weaknesses  of  tho  pilots  os  a 
check  of  tho  effectiveness  of  tho  curriculum  and  as  a  possible  means 
of  deciding  wlmt  refresher  courses  they  needed. 
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Most  effort  was  devoted  to  the  development  of  these  tests  for  selec¬ 
tion  purposes.  The  scores  from  these  tests,  of  course,  wero  only  ono 
of  the  factors  to  he  taken  into  account  in  selecting  pilots  on  the  basis 
of  their  achievement  in  advanced  stages  of  training.  Other  factors, 
such  as  flying  skill,  interest,  and  attitude  had  also  to  be  considered. 
The  scope  of  testing  was  limited  to  the  measurement  of  those  aspects 
of  flying  information  which  were  essential  to  tho  good  pilot  and  which 
could  he  thoroughly  measured  with  greater  economy  on  the  ground 
than  in  the  air.  Tho  tests  were  designed  to  measure  the  type  of  in¬ 
formation  needed  by  the  pilots,  whether  or  not  it  was  included  in  tho 
curriculum. 

GENERAL  APPROACH  AND  TECHNIQUES  OF 
TEST  CONSTRUCTION 

Selection  of  Areas  To  Re  Tested 

Tho  purposes  of  testing  determined  the  areas  to  bo  sampled.  The 
contents  of  these  areas  were  based  upon  the  opinions  of  experts,  tech¬ 
nical  manuals,  tho  curricula  of  pilot  schools,  and  accident  statistics. 
Since  areas  of  flying  information  were  well  defined  and  categorized  in 
the  Army  Air  Forces,  it  wns  a  relatively  easy  process  to  select  suitable 
areas  for  testing.  The  main  areas  selected  were  analysis  of  maneuvers, 
navigation,  aeroequipment,  instrument  flying,  weather,  and  the  use 
of  oxygen  equipment. 

Writing  of  Test  Items  and  Consultation  With  Experts 

Items  for  tho  various  tests  wero  based  on  tho  latest  authoritative 
regulations,  manuals,  and  references  in  use  in  tho  Army  Air  Forces. 
Experts  were  consulted  to  insuro  that  tho  test  items  wero  functional, 
important,  and  not  likely  to  become  obsoloto  as  frequent  technical 
changes  were  introduced.  Consideration  wns  also  given  to  tho 
probable  diflkulty  and  clarity  of  tho  test  items.  Persons  in  responsible 
positions  wero  consulted  ns  direct  sources  for  test  items.  In  some 
cases,  old  test  forms  used  in  ground  schools  and  on  flight  lines  were 
scanned  for  ideas  and  items.  All  items  wero  rewritten  in  multiple- 
choice  form  in  order  to  reduce  the  effects  of  guessing  and  to  incrcaso 
test  reliability.  Catch  questions  or  ambiguous  items  wero  weeded 
out.  The  final  criterion  for  the  inclusion  of  a  test  item  wns,  “Would 
the  pilot  be  likely  to  get  into  trouble  if  he  didn’t  have  this  informa¬ 
tion?” 

A  4-point  rating  scale  wns  employed  with  expert  pilots  to  evaluate 
tho  importance  of  each  item.  Tho  uncorrccted  correlation  between 
the  average  rating  of  one  group  of  five  experts  with  another  of  seven, 
was  0.50.  This  permitted  the  selection  of  those  items  on  which  there 
was  substantial  agreement  among  experts. 

This  technique  wns  employed  in  t  he  development  of  three  of  tho 
subsections  of  tho  tost  (instrument  flying,  weather,  and  personal 
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equipment),  since  groups  of  experts  were  Available  only  in  these  areas. 

Because  the  exncrts  clitl  not  agree  on  the  relative  importance  of 
different  areas  as  well  as  they  did  on  items  within  an  area,  this  tech¬ 
nique  could  not  be  used  in  weighting  the  various  subsections  of  the 
test.  This  difficulty  was  not  a  reflection  upon  tho  technique,  but 
rather  symptomatic  of  the  subject  matter.  Depending  upon  tho 
situation,  normal  or  emergency,  the  importance  of  ono  area  may  bo 
temporarily  increased  over  that  of  all  others.  Therefore,  the  inclusion 
of  a  particular  test  item  was  based  not  on  tho  a  priori  significance  of 
an  areu,  but  rather  on  the  importance  of  the  specific  point  of  informa¬ 
tion. 

When  available,  evaluation  boards  performed  technical  verification 
of  test  items  and  official  coordination  for  tho  Army  Air  Forces.  Tho 
AAF  Instrument  Flying  Standardization  Board  at  Bryan  Army  Air 
Field,  Bryan,  Tex.,  was  consulted,  and  other  groups  offered  expert 
help  in  the  development  of  the  printed  tests.  Tho  organizations  rep¬ 
resented  included: 

(1)  Basic  and  twin-engino  groups,  AAF  Central  Instructors 
School,  Randolph  Field,  Tex. 

(2)  Ground  Training  Technical  Advisory  Department,  Randolph 
Field,  Tex. 

(3)  Ground-school  personnel,  Lockbourno  Army  Air  Field  (Central 
I  structors  School  for  B-I7  pilots). 

(4)  Ground-school  personnel,  Smyrna  Army  Air  Field  (Central 
Instructors  School  for  B-24  pilots). 

(o)  Returned  combat  pilots  in  the  Flight  Test  Section  and  Staff  of 
the  Physiological  Section,  Proving  Ground  Command,  Kglin  Field,  Fla. 

(G)  Multienginc  squadron  of  returned  combat  pilots,  AAF  School 
of  Applied  Tactics,  Orlando,  Fla. 

(7)  Physiology  Department,  School  of  Aviation  Mcdicino,  Ran¬ 
dolph  Field,  Tex. 

(5)  Station  Standardization  Board  for  instrument  flying,  ground- 
school  instructors  who  wero  rated  pilots,  nml  tho  AAF  Instrument 
Flying  Standardization  Board,  Bryan  Army  Air  Field,  Brynn,  Tex. 

(9)  Psychological  Section,  Olfico  of  tho  Surgeon,  Ilq.  A/VF  Train¬ 
ing  Command,  Fort  Worth,  Tex. 

(10)  A-3  Division,  Ilq.  AAF  Central  Flying  Training  Command, 
Randolph  Field,  Tex. 

Trial  Administration  and  Statistical  Analysis 

After  a  series  of  test  items  had  been  examined  for  tedinicol  correct¬ 
ness  and  clarity  of  wording,  they  were  mimeographed  in  test  booklets 
and  administered  to  samples  drawn  from  populations  whose  acliiovo- 
ment  level  was  comparublo  to  the  level  of  pilot  performance  ultimately 
to  be  tested.  Generally,  similar  analyses  were  nmdo  for  ult  testa, 
though  the  size  of  the  population  ami  practical  considerations  some- 
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times  dictated  a  less  complete  analysis  of  data.  When  a  test  was 
fully  analyzed,  the  following  calculations  were  made: 

(1)  Means  and  standard  deviations  of  subtests  and  total  score. 

(2)  Test  reliability  (odd  even  technique  using  Rulon  formula).” 

(3)  Subtest  intcrcorrelations  (Pearson  product-moment). 

(4)  Determination  of  difficulty  level  of  each  item. 

(5)  Item  anulysis  of  internal  consistency  according  to  the  upper- 
lower  27  percent  technique.” 

(C)  Correlation  with  grades  in  ground  school  and  flight  line. 
Revision  on  the  Basis  of  Empirical  Findings 

Tho  results  of  the  preliminary  administration  provided  a  basis  for 
eliminating  those  items  which  dealt  with  controversial  material,  were 
poorly  worded,  ambiguous,  and  cither  too  easy  or  too  difficult.  Tho 
first  point  to  be  considered  was  the  level  of  difficulty  of  the  question 
and  the  attractiveness  of  each  of  ita  alternative  choices.  An  item 
answered  correctly  by  only  10  percent  or  by  more  than  90  percent  of 
the  students  was  considered  undesirable  because  it  did  not  add  much 
to  the  total  test  reliability.  For  the  same  reason  any  alternato  choice 
which  failed  to  attract  responses  was  revised.  Those  incorrect 
alternate  choices  which  received  too  many  responses  were  also  revised. 

The  measure  of  internal  consistency  (agreement  of  each  item  with 
the  total  score  on  the  test)  was  used  chiefly  to  spot  possible  ambiguities 
in  the  questions.  If  the  27  percent  of  the  students  who  got  the  highest 
total  scores  on  the  test  did  not  do  better  on  a  given  question  than  the 
27  percent  who  got  the  lowest  total  scores  on  tho  test,  that  question 
wus  scrutinized  for  content  and  ambiguity.  If  the  item  looked  doubt¬ 
ful,  it  was  revised  or  discarded;  if  not,  it  was  kept. 

Intoned  consistency  was  not  used  as  a  decisive  criterion  bccauso 
tliero  is  no  logical  reason  for  expecting  the  knowledge  of  different 
types  of  information  in  this  area  to  be  highly  correlated.  An  item 
which  is  not  related  to  the  total  score  on  the  rest  of  the  test,  but  is 
well  worded  and  covers  an  important  point,  odds  to  tho  comprehen¬ 
siveness  of  the  test  by  tapping  an  independent  area  of  information. 

The  general  procedure  was  to  show  specialists  in  each  area  of  flying 
tho  distributions  from  both  the  level  of  difficulty  and  tho  internal 
consistency  analyses,  to  discuss  these  data,  and  encourage  them  to 
suggest  revisions. 

Administration  of  Revised  Test 

Tho  revised  test  was  then  administered  to  a  second  sample  similar 
to  tho  first  80  that  results  would  bo  comparable.  The  results  of  this 
second  administration  were  then  used  for  further  analysis. 

*•110100.  Phillip  J.,  A  Pltn|i|lfl«l  ProorOuiT  for  Drtrrmlnlnjt  ihe  ItrlhNIitjr  of  •  Trrt  bjr  Sptlt-nalrr*. 
//•rrartf  MuethitJ  llrthtr,  IVcW,  *:  MM 01. 

"  Kl»n**;»n,  John  O.,  turn  Analysis  by  Trsl  Scoring  Mtchlrw  Graphic  Itrra  Counter,  Pret*t4lnti *f  Ik* 
fdueill»n*l  /'•ram,  Intrriuilioiul  Buslnra*  Mtchlnrt  Cortorattuo,  AufUft  1(40,  pp.  tt-94. 
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Statistical  Analysis  and  Further  Revision 

A  set  of  complete  statistics  was  obtained  on  the  second  administra- 
tion  of  tho  test  in  order  to  make  a  final  evaluation  of  tho  test  beforo 
printing  for  actual  use. 

Validation 

Because  so  much  of  the  information  tested  was  of  a  typo  which 
would  be  useful  only  in  tactical  operations  or  combat  and  not  during 
the  earlier  stages  of  training,  there  did  not  seem  to  be  much  point  in 
validating  the  tests  against  the  criteria  available  in  tho  somewhat 
protected  environment  of  tho  Training  Command.  Tho  tests  wero 
put  into  use  after  experimental  administration  had  demonstrated  that 
they  yielded  reliable  measures  of  those  points  of  information  which 
experts  considered  to  bo  relevant. 

This  procedure  is  less  safe  than  validation  against  a  good  criterion, 
where  one  is  available.  Plans  were  formulated  to  follow  (ho  crew 
members  tested  in  the  Training  Command  through  subsequent  train¬ 
ing  in  the  Continental  Air  Forces  and  performance  in  tho  combat 
theaters  with  tho  cooperation  of  the  psychological  organizations  in 
those  places.  Such  validation,  though  didicult,  would  havo  been  a 
better  proof  of  the  tests  but  the  end  of  the  war  occurred  beforo  it 
couM  be  carried  out.  Even  had  it  beer  pc  ible  to  make  this  follow-up, 
two  difTicult  ’s  would  have  been  encountered:  tho  measures  of  com¬ 
bat  performance  would  have  been  relatively  unreliable,  and  tho  spe¬ 
cific  points  of  information  which  were  most  important  at  the  time 
when  tho  study  was  made  might  have  become  rapidly  obsolcto  as 
techniques  were  rapidly  improved. 

TIIE  PRACTICAL  USE  AND  STATISTICAL  ANALYSIS  OF  TIIE 

TESTS  CONSTRUCTED 

In  all,  work  was  done  on  five  tests.  Of  these,  two,  tho  Combat 
Flying  Judgment  Test  and  the  B-17  Check-Out  Test,  remained  in 
undeveloped  stnges  and  three  were  completed.  One  of  tho  three 
tests  was  used  for  selection  purposes,  a  second  on  a  try-out  basis  at 
AAF  Redistribution  stations,  and  the  third  wus  used  throughout  tho 
Training  Command  for  examining  instrument  pilots.  Since  theso 
tests  affected  Army  Air  Forces'  practices,  a  description  of  tho  content, 
uso,  and  statistical  data  on  each  is  presented. 

Pilot  Information  Test,  Form  3  (Multi-Engine),  Booklet*  I  and  II 

Tho  Pilot  Information  Test,  Form  3,  was  developed  to  aid  in  tho 
selection  of  potential  lead-crew  pilots  in  the  Very  Heavy  Bombard¬ 
ment  program.  Tho  score  on  this  test  in  combination  with  previous 
pilot  experience,  pilot  stnnine,  and  proficiency  grades  was  weighted  in 
selecting  tho  host  pilots  to  bo  grouped  with  tho  best  navigators, 
bombardiers,  and  flight  engineers  for  training  ns  potential  lead  crows. 
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The  test  was  composed  of  276  multiple-choice  items.  The  areas 
measured  were  analysis  of  maneuvers,  navigation,  acrocquipmcnt, 
instrument  flying,  weather,  and  uso  of  oxygen  equipment.  Illus¬ 
trative  items  follow: 

In  order  to  hold  a  constant  rate  of  turn  when  air  speed  is  building 
up,  angle  of  hank  should  be — 

A.  Increased. 

11.  Maintained. 

C.  Reduced. 

If  the  regular  static  line  as  well  as  tho  alternate  sourco  aro  blocked, 
static  pressure  can  be  obtained— 

A.  From  altcnmto  vacuum  sourco. 

II.  By  breaking  the  glass  of  tho  instrument. 

C.  From  alternate  sourco  venturi. 

D.  By  switching  to  an  engine-driven  pump. 

Variation  is  6°  E.  Wind  is  from  50°.  In  order  to  mnko  good  a 
truo  course  of  90°,  ono  should— 

A.  Crab  to  tho  left. 

B.  Crab  to  tho  right. 

C.  Fly  a  heading  of  84°. 

D.  Fly  a  heading  of  96°. 

Total  administration  time,  which  included  directions  and  actual 
testing  timo  was  8  horn's;  of  this,  actual  testing  timo  for  booklet  I 
was  70  minutes,  for  booklet  II  was  85  minutes.  This  time  allowance 
permitted  practically  all  men  to  finish  the  test.  Since  the  correlation 
between  test  score  and  test  timo  was  0.12,  it  was  decided  not  to  make 
this  a  speed  test.  Tho  test  scoro  was  tho  total  number  of  correct 
answers. 

Tho  basic  statistics  of  tho  Pilot  Information  Test,  Form  3,  are 
presented  for  371  randomly  selected  test  papers  supplied  by  Psycholog¬ 
ical  Research  Project  (Combat  Crew)  at  Lincoln,  Nebr.  The  average 
of  tho  levels  of  difficulty  (percent  answering  correctly)  for  tho  items 
in  this  test  is  68  percent. 


Taiilr  12.1. — / ntercorrrlationt  and  rrliabilitiet  ot  the  tubiecfiont  of  the  pilot 

information  teit,  form  3  (!\=>37t) 
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The  data  in  table  12.1  show  that  tho  test  provided  an  adequate 
distribution  of  scores  for  use  in  a  selection  battery.  Tho  fairly  high 
reliability  of  0.85  for  the  total  score  means  that  those  who  scored  high 
on  tho  test  did  not  do  so  bccauso  of  chanco  factors  like  guessing  or 
luck;  therefore  a  pilot’s  score  was  probably  based  on  what  he  know 
about  the  areas  being  tested. 

From  table  12.1  it  can  bo  seen  that  tho  intcrcorrolations  among 
various  subsections  of  tho  test  aro  relatively  low.  In  tablo  12.2  theso 

Table  12.2. — Independence  of  the  tubiectiont  of  pilot  information  fell,  Form  S 

Inlercorrelations  Corrected  for  Attenuation:  Multipio  Correlations  and  Co¬ 
efficients  of  Multiple  Non-Dctcrinination  Based  Upon  tho  Corrected  Inter* 
correlations 
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R  I*  tbe  multipio  correlation  ot  the  subsection  with  all  of  the  other  subsections,  L  e.  It  1.23 1 JA,  R  2.13*34, 
etc. 

K*  Is  the  coefficient  of  multiple  nomlrtermlnatlon  (l-/?Oen«l  Is  a  conservative  estimate  of  the  percenter# 
of  variance  In  a  perfectly  reliable  measure  of  the  factors  Involved  In  each  subsection  which  could  not  he 
accounted  for  by  perfectly  reliable  mra>urej  of  the  factors  Involved  In  all  of  the  other  subsections.  Thus  It 
Is  an  Indes  or  tho  degree  to  which  each  area  of  Information  Is  Independent  of  the  others. 

intcrcorrolations  have  been  corrected  for  attontuation  in  order  to 
estimate  how  high  they  would  bo  if  each  typo  of  information  woro 
measured  by  a  perfectly  reliable  test.  Tho  fact  that  tho  correlations 
aro  still  below  1.00  indicates  that  no  two  tests  measuro  exactly  tho 
snmo  thing.  Tho  question  of  how  well  perfectly  reliable  tests  in 
five  of  the  areas  would  completely  account  for  the  sixth  area  was 
answered  by  computing  coefficients  of  multiple  nondetermination 
based  upon  multiple  correlations.  Theso  are  presented  in  tho  last 
column  of  table  12.2.  It  can  bo  seen  that  the  most  independent 
areas  aro  Navigation,  Instrmncnt  Flying,  and  Weather.  Approxi¬ 
mately  ono  quarter  of  tho  variance  in  each  of  these  areas  would  bo 
left  unaccounted  for  by  perfectly  reliable  tests  in  tho  other  five  areas. 
This  is  a  conservative  estimate  since  multiple  correlations  tend  to 
shrink  upon  cross-application  of  beta  weights,  leaving  somowhat 
more  varianco  unaccounted  for. 

Biographical  data  accompanying  tho  tost  papers  supplied  by 
Psychological  Research  Project  (Combat  Crew)  were  analyzed  in  A 
number  of  ways  at  Psychological  Research  Project  (Pilot). 

The  scores  were  tabulated  separately  for  pilots  and  copilots  and 
for  those  who  had  served  as  instructors  and  those  who  had  not  been 
instructors.  The  results  are  presented  in  table  12.3.  There  was  no 
significant  difference  between  the  test  scores  of  those  assigned  as  pilots 
or  as  copilots. 
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Table  12.3. — A  companion  of  the  tcorei  on  the  pilot  information  teit  ( Form  3)  of 
pilot i,  copilot*,  imtructor*,  ana  nonimtrudor » 
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When  the  data  were  broken  clown  further,  it  was  found  that  the  co¬ 
pilots  who  had  not  served  as  instructors  obtained  better  scores  than 
the  pilots  who  had  not  served  as  instructors.  The  difference  was  of  a 
size  (<  =  2.91)  which  would  be  expected  by  chance  loss  than  one  time  in 
100.  The  noninstructor  copilots  have  an  average  of  400  hours  flying 
time  while  the  noninstructor  pilots  had  1,500.  The  most  plausiblo  in¬ 
terpretation  of  the  difference  between  the  test  scores  of  these  two 
groups  is  that,  since  the  pilots  with  more  flying  timo  had  graduated 
earlier,  they  had  received  the  less  comprehensive  ground  school  train¬ 
ing  which  was  given  during  that  earlier  period,  and  had  had  more 
time  to  forget  what  they  had  learned.  The  more  recently  gradu¬ 
ated  copilots  had  received  tho  benefit  of  the  improvement  in  training 
and  lmd  had  less  timo  to  forget. 

This  interpretation  tends  to  be  confirmed  by  the  fact  that  the 
instructor  pilots,  who  presumably  arc  kept  more  up  to  date  by  the 
nature  of  their  job,  scored  better  on  tho  test  than  cither  the  nonin¬ 
structor  pilots  or  the  noninstructor  copilots,  the  differences  being  of 
a  size  (f=4.S9  and  2.24)  which  would  be  expected  by  chance  less  than 
1  and  less  than  5  times  out  of  100,  respectively.  Thcso  differences 
may  have  also  been  caused  by  the  selection  of  the  better  pilots  U> 
become  instructors.  They  could  not  have  been  caused  by  difference 
in  the  amount  of  flying  time  since  tho  instructor  and  noninstructor 
pilots  were  approximately  equal  in  this  respect. 

The  correlation  between  number  of  years  of  education  and  scoro  on 
this  test  was  found  to  be  0.05  (AT=3G2),  indicating  that  the  factors 
measured  by  this  test  were  not  related  to  the  formal  education  of  tlieso 
students. 

Finally,  Psychological  Research  Project  (combat  crew)  has  shown 
that  this  test  correlated  0.10  (iV=480)  with  the  subjective  grade  of 
flying  skill  given  at  the  transition  schools  and  0.32  (AT=544)  with  the 
pilot  Rtanine.  It  is  interesting,  though  not  surprising,  to  noto  that 
the  pilot  stanine  predicts  the  score  on  this  pilot  information  achieve¬ 
ment  test  better  thnn  does  previous  education. 

The  P.  I).  C.  (Personnel  Distribution  Command)  Pilot  Information  Test 
Form  1 

At  the  request  of  the  redistribution  psychological  program  in  the 
AAF  Personnel  Distribution  Command,  a  Pilot  Information  Test  of 
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150  multiple-choice  items  wns  prepared  for  possible  use  in  the  instruc¬ 
tor  selection  battery  administered  to  rcturnco  pilots.  This  test  wns 
designed  to  replace  the  Analysis  of  Maneuvers  Test  described  in 
Chapter  14  on  Instructor  Selection  and  was  given  the  Personnel  Dis¬ 
tribution  Command  test  code  number  DS4044.  The  test  contains  25 
items  on  analysis  of  maneuvers,  25  on  navigation,  25  on  acrocquip- 
ment,  25  on  instrument  flying,  25  on  weather,  and  25  on  personal 
equipment.  These  150  test  items  were  taken  directly  from  tho  Pilot 
Information  Test,  Form  3. 

The  test  items  were  adapted  for  both  single-  and  multi-engine  pilots 
and  the  whole  examination  required  80  minutes  of  time  to  administer 
ns  a  power  test.  The  total  score  is  the  sum  of  the  number  of  correct 
answers. 

The  Psychological  Branch  at  AAF  Redistribution  Station  No.  2, 
Miami  Bench,  Fla.,  administered  this  test  experimentally  nnd  worked 
up  the  data  on  371  pilots.  These  arc  presented  in  tablo  12.4. 


Tadle  12.4. — Odd-evtn  rtliabilily  of  the  pilot -  information  teit  {P DC  Form  I) 


StmpU 

AT 

M 

SO 

ru 

OiM  items  . 

371 

43.17 

an 

Even  Items . . . 

371 

44.  M 

a  it 

T«lil  Hems . 

371 

*7.70 

11.40 

Mi 

It  can  be  seen  that  the  distribution  of  scores  on  the  test  and  the 
odd-even  reliability  of  0.81  are  satisfactory.  Tho  test  was  considered 
to  bo  readily  administrate  and  suitable  for  use  in  the  redistribution 
stations. 

The  mean  item  level  of  difficulty  of  the  Pilot  Information  Test, 
Form  1,  P.  D.  C.,  is  58  percent.  All  items  were  answered  correctly  by 
more  of  the  students  whose  total  scores  were  in  the  top  27  percent  than 
by  those  in  the  bottom  27  percent.  In  other  words,  none  of  tho  items 
wore  inconsistent  with  the  rest  of  tho  test. 

In  table  12.5,  a  comparison  of  the  mean  item  level  of  difficulty  of 
150  items  common  to  the  Pilot  Information  Test,  Form  3,  and  tho 
Pilot  Information  Test,  Form  1,  P.  D.  C.,  shows  that  in  each  sub¬ 
section  of  the  test  the  transition-school  pilots  aro  better  than  tho 
returned  combat  pilots.  This  superiority  wns  probably  not  duo  to  tho 
fact  that  the  returned  combat  pilots  were  both  singlo  and  multi- 
engine  pilots  wliito  the  transition-school  graduates  were  all  multicngino, 
very  heavy  bombardment  pilots;  the  Psychological  Branch  of  Redis¬ 
tribution  Station  No.  2  at  Miami  Beach,  Fla.,  found  that  tho  difference, 
if  any,  between  these  two  types  of  pilots  on  the  scores  in  a  similar  test, 
Anulysis  of  Maneuvers,  was  in  favor  of  the  singlc-engino  pilots. 
Furthermore,  in  testing  advanced-school  students  trained  ntsingle-nnd 
twin-engine  schools,  no  differences  were  found  on  similar  test  items. 
Thus,  it  seems  likely  that  the  superiority  of  the  more  recent  graduate's 
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was  due  to  improvement  in  the  curriculum  on  which  they  were  trained 
and  less  time  for  forgetting.  However,  since  tho  stanino  level  of  the 
two  group:  was  not  controlled,  tho  obtained  di/Tcrcnce  might  be  due, 
at  least  in  part,  to  a  difference  in  stanino  for  the  two  groups.  Such  a 
difference  could  easily  occur,  if  the  returned  combat  pilots  had  been 
tested  appreciably  earlier  than  the  transition  pilots. 


Table  12.5. — A  companion  of  tcorei  on  (he  pilot  information  tetl  (PDC  Form  /) 
made  by  returnee  and  by  Irantitior^echool  pilots 


SubMcUoa 

Very  hr  try 
bombardment 
transition 
pilots  (//a*71) 

Returned 

combat 

pilots 

(AT-J7I) 

Flying  Information  . - . . 

n — - a 

rCiirai 

« 

| 

71 

a 

8 

M 

Ptrttwi  n 

■ 

« 

■ 

| 

Pfrson&l*'iul[>incnt  Information . 

Total  trft . . 

•7 

« 

1 

The  Pilot  Instrument  Flying  Information  Test 

As  has  already  been  pointed  out,  tho  extremo  importance  of  instill* 
ment  flying  was  one  of  tho  reasons  why  tho  Pilot  Project  concentrated 
in  developing  objcctivo  measures  of  flying  skill  for  that  typo  of  flying. 
But,  as  was  shown  in  chapter  3,  tho  good  instrument  pilot  needs 
knowlcdgo  ns  well  ns  skill.  The  Pilot  Project,  therefore,  also  devel¬ 
oped  tests  aimed  at  thoso  types  of  knowlcdgo  involved  in  instrument 
flying  which  could  bo  measured  moro  efficiently  on  tho  ground  than 
in  tho  air. 

Tho  Pilot  Instrument  Flying  Information  Test  (Preliminary  Form) 
was  composed  of  145  items  with  a  scopo  including  tho  following 
categories:  Principles  of  operation  and  limits  of  tho  flight  instru¬ 
ments,  radio  compass  operation  and  procedures,  AAF  instrument 
approach  system,  radio  rango,  flight  rules,  instrument  procedures, 
instrument  flying  problems,  weather  fronts,  thunderstorms,  icing, 
wind,  fog,  atmospheric  stability,  weather  reports,  flight  planning, 
weather  maps,  weather  flight  procedures,  and  judgment  based  on  these 
facts.  ) 

This  test  was  constructed  with  tho  cooperation  of  expert  personnel 
of  tho  AAF  Instrument  Flying  Standardization  Board.  This  board 
verified  technical  information  in  tho  test  and  recommended  its  use 
as  a  prerequisite  to  tho  oral  examination  for  tho  white  card  which 
authorizes  a  pilot  to  fly  under  instrument  conditions.  Snmplo  items 
from  tho  test  follow: 

If  tho  ball  moves  to  tho  low  sido  of  tho  turn,  it  indicates  a  slip 
duo  to 

A.  overbanking. 
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B.  undcrlmnking, 

C.  rato  of  turn. 

Exclusivo  of  tnkc-olT^  and  landing  tho  minimum  altitude  above 
terrain  on  instrument  flights  shall  be 

A.  500  feet. 

B.  1,000  feet. 

C.  1,500  feet. 

D.  2,000  feet. 

The  general  limits  of  operation  of  tho  artificial  horizon  are 

A.  00°  pitch  and  00°  bank. 

B.  70®  pitch  and  56®  bank. 

C.  80®  pitch  and  100°  bank. 

D.  90®  pitch  and  100°  bank. 

In  recovery  from  a  diving  spiral,  where  air  speed  is  cxccssivo,  first 

A.  rcduco  power,  level  wings,  and  correct  pitch  altitude. 

B.  stop  turn  and  check  cxccssivo  speed. 

C.  pull  back  on  stick  and  coordinate  rudder  and  ailerons. 

D.  stop  turn,  rcduco  power,  and  lower  nose. 

The  examination  required  00  minutes  of  time  for  administration. 
Tho  total  score  is  tho  number  of  correct  responses. 

Mimeographed  copies  of  tho  Pilot  Instrument  Flying  Information 
Test  (preliminary  form),  wero  administered  by  personnel  in  tho  Pilot 
Project  to  151  advanced  pilot  students  (Class  45D)  at  Dougins  Army 
Air  Field,  twin-ongino  school,  Douglas,  Ariz.,  and  to  104  advanced 
pilot  students  (Claims  45D)  at  Luke  Army  Air  Field,  single-engine 
school,  Phoenix,  Ariz.  Sufficient  time  was  allowed  for  all  students  to 
complcto  tho  test. 

Tho  means,  standard  deviations,  and  reliabilities  of  tho  total  test 
and  each  of  tho  subsections  together  with  reliabilities  of  tho  total 
test  for  the  Douglas  Army  Air  Field  sample,  tho  Luke  Army  Air 
Field  sample,  and  tho  combined  samples  nro  shown  in  tablo  12.0.M 


Table  12.0. — Mran,  itandard  deviation,  and  odd-even  reliability  of  the  pilot  trufrit* 
ment  flying  information  teit  {preliminary  form) 
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an  Inherent  port  ot  tbli  formula.) 

*  Combined  by  KUber’i  s-tranatormatloa. 

r  9 

Tho  Pilot  Instrument  Flying  Information  Test  (preliminary  form) 
has  a  satisfactory  range  warranting  its  uso  for  selection  purposes. 

M  Pie  Stuart  Foutke  and  Pie  William  U.  Wkaenbrrg  warn  rwponilbto  tor  mtat  ot  the  analysis  of  dal* 
r* ported  la  table*  12.1, 127,  and  IIS. 
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Results  from  the  two  schools  arc  similar.  Tho  agreement  between 
tlio  odd  and  tho  even  sections  of  tho  test  indicatos  that  it  gives  an 
accurato  total  scoro  not  greatly  influenced  by  chance  factors.  Tho 
correlation  between  tho  two  subsections  (Instrument  Flying  and 
Weather)  of  tho  Pilot  Instrument  Flying  Information  Test  (pre¬ 
liminary  form)  is  0.57.  As  table  12.7  shows,  thore  is  a  positive 
relationship  between  the  total  test  scoro  and  tho  pilot  stanino. 


Tadle  12.7. — Correlation  oj  pilot  instrument  Jlyinq  information  test  ( preliminary 

form)  with  the  pilot  stantna 
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fii  Odd-even  reliability  of  I'llot  Instrument  Informs! Ion  Test  computed  by  the  Ituloo  Formula  (tbs  ! 
Spearman- llrown  correction  for  double  lonrth  Is  sn  Inherent  psrt  of  this  formula), 
r.ia  t'ncometrd  corrrlitlon  of  test  with  the  pilot  stanlne. 

rr.i.  Correlation  of  test  with  pilot  stanlne  corrected  for  restriction  of  ranee  by  use  of  formula  presented 
by  krllcy.  T.  L.,  Statistical  Method.  Macmillan,  Near  York,  1921,  pp.  221-07. 

•  Combined  by  Flsbcr'a  a-Transfunnalloo. 

a 

The  correlations  of  each  sub-section  of  the  test  with  grades  in  the 
two  ground  school  subjects,  flight  instruments  and  weather,  are  shown 
in  tablo  12.8. 


Tamx  12.8.—  Correlations  between  ground- school  grades  and  scores  on  subsections 
of  the  pilot-instrument  flying-information  test  (preliminary  form) 
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i  She  ppnrd'e  correction  tor  grouped  data  was  used  on  the  Luke  data  only,  because  the  scores  were  recorded 
by  biter  grade  while  Ute  Dougins  cron 'id  school  erodes  wero  raw  numerical  scores.  The  unoorrected  figure*  ; 
for  the  Luke  (Ught  Instrument  and  wrsther  correlations  are 0.11  and  0.44  respectively. 
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Tlio  correlation  between  tho  instrument  flying  section  of  tho  Pilot  J 
Instrument  Hying  Information  Test  (preliminary  form)  and  tho 
ground  school  grades  in  flight  instruments  aro  positivo  but  low.  In 
contrast,  tlio  correlation  between  tho  Weather  section  of  tho  Pilot 
Instrument  Flying  Information  Test  (preliminary  form)  and  ground 
school  grades  in  weather  aro  significantly  higher.  This  difTcrcnco 
may  bo  duo  to  tho  fact  that  only  7  hours  aro  dovoted  to  flight  instru¬ 
ments  in  ground  school  while  17  hours  aro  devoted  to  weather. 

This  form  of  the  Pilot  Instrument  Flying  Information  Test  was  1 
revised  to  a  150-item  printed  test  called  Form  A.  An  altomato  form  > 
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of  the  test,  Form  B,  was  completed  nnd  made  ready  for  use  as  a 
“selective  or  diagnostic  instrument."  No  statistics  wero  available  on 
these  two  forms  by  the  end  of  the  war,  though  it  was  highly  probablo 
that  they  wero  comparable  to  each  other  and  to  tho  preliminary  form 
of  the  Pilot  Instrument  Flying  Information  Test  described  abovo. 
Tho  AAF  Instrument  Flying  Standardization  Board  recommended 
theso  forms  for  uso  throughout  tho  Air  Forces  as  one  of  the  require¬ 
ments  for  tho  card  which  signifies  that  a  pilot  may  bo  cleared  for 
instrument  flights  and  tho  Training  Command  adopted  them  for 
this  use. 

SUMMARY 

Reports  from  theaters  of  operation  stressed  tho  importance  in 
combat  flying  of  good  judgment  based  on  a  thorough  knowledge  of 
practical  aero-dynamics,  navigation,  aero-equipment,  personal  equip¬ 
ment,  weather,  and  principles  of  instrument  flying.  Knowledge  in 
these  areas  was  considered  to  be  a  necessary,  though  not  a  sufficient, 
condition  for  good  judgment  in  combat  flying.  Kxpcrts  in  each  of 
these  areas  wero  asked  to  select  thoso  points  of  information  most 
useful  in  keeping  pilots  out  of  troublo  or  helping  them  solvo  problems. 
A  battery  of  subtests  was  constructed  to  givo  rcliablo  measures  of 
theso  points  of  information.  This  battery  was  administered  experi¬ 
mentally  and  refined  on  tho  basis  of  item  analysis.  Theso  testa, 
along  with  other  variables  such  ns  flying  grades,  Irnvo  been  used  in 
selecting  tho  best  pilots  to  bo  grouped  with  tho  best  navigators, 
bombardiers,  and  flight  engineers  for  training  ns  potential  lead  cron’s. 

Two  other  tests  hnvo  been  constructed.  One  of  theso  was  devel¬ 
oped  for  possiblo  uso  as  ono  of  tho  tests  in  nn  improved  pilot  instructor 
selection  battery  to  bo  administered  at  AAF  Redistribution  stations. 
Tho  other  test  covered  information  relovant  to  instrument  flying, 
flight  planning,  and  weather.  Tho  AAF  Instrument  Flying  Stand¬ 
ardization  Board  has  recommended  this  test  ns  ono  of  the  requirements 
for  securing  the  instrument  card  which  authorizes  a  pilot  to  fly  under 
instrument  conditions. 
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CHAPTER  THIRTEEN 


Training  Experiments 

1st  Lt.  William  E.  Galt 


INTRODUCTION 

Value  of  Scientifically  Designed  Experiments 

Planning  the  best  program  of  pilot  training  involves  many  problems 
which  can  be  solved  conclusively  only  by  training  experiments.  Ths 
more  scientifically  theso  experiments  aro  designed,  tho  easier  it  is  to 
get  accurate,  dccisivo  results. 

Many  of  these  problems  involve  fundamental  factors  in  human 
learning,  such  as  distribution  of  practice  and  transfer  of  training, 
which  psychologists  have  already  investigated  in  the  laboratory.  For 
example,  fixed  gunnery  training  is  given  first  on  the  less  expensive  and 
lower  powered  AT-G  with  the  expectation  that  tho  pilot  will  benefit 
by  the  transfer  of  that  training  to  higher  powered  tactical  planes  such 
as  tho  P-51.  Similarly,  students  are  first  given  training  on  smullor 
singlc-cngino  planes  to  mako  it  easier  for  them  to  learn  to  handlo  two* 
and  four-engine  aircraft.  Some  of  tho  habits  learned  on  tho  lighter 
piano  apply  to  tho  heavier  ono  and  arc  a  distinct  advantage;  others, 
however,  may  not  apply  and  may  actually  cause  a  certain  amount 
of  habit  interference.  Tho  net  effects  of  tho  positivo  and  negative 
transfer  can  bo  expected  to  vary,  depending  on  tho  similarity  of  the 
two  situations  and  tho  typo  ami  amount  of  training  given.  Under 
some  conditions  the  effects  of  the  first  training  may  be  beneficial;  but 
it  is  also  possible  in  sonro  eases  for  such  training  to  ho  Inrgely  wasted 
or  even  harmful;  or  a  limited  amount  of  training  may  he  vuluablo,  but 
more  than  this  amount  a  wasto  of  time.  While  tho  results  of  lakora- 
tory  experiments  cannot  predict  exactly  what  will  happen  in  a  com¬ 
plex  situation  like  that  involved  in  flying  training,  they  can  tell  ona 
wlmt  to  look  for  and  how  to  go  about  setting  up  a  series  of  training 
experiments  to  dccido  what  kinds  and  amounts  of  training  at  each 
level  will  bo  most  efficient  in  tho  long  run. 

Scientific  Experiment  Involves  More  Than  Just  Trying  Something  Out 

Whilo  tho  essential  idea  behind  the  experimental  approach  is  trying 
something  out  to  seo  how  it  works,  a  truly  scientific  experiment  in¬ 
volves  far  moro  than  this.  Its  great  power  lies  in  tho  fact  that  condi¬ 
tions  are  arrunged  so  that  tho  effects  of  disturbing  factors  aro  con¬ 
trolled  or  cancelled  out  and  tho  results  are  decisivo  und  unambiguous. 
It  is  also  necessary  to  deviso  somo  way  of  measuring  theso  results  so 
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that  they  can  bo  stated  clearly  and  interpreted  in  the  same  way  by 
everyone. 

Little  Psychological  Work  on  Training  Experiments  During  the  War 

Serving  as  consultants  on  the  scientific  design  of  experiments  to 
evaluate  training  methods  and  devices  should  ultimately  bo  one  of 
the  more  useful  functions  of  psychological  personnel  working  with  the 
Army  Air  Forces.  Under  the  stress  of  work  to  bo  accomplished  dur¬ 
ing  the  years  of  the  war,  however,  tho  activities  of  aviation  psycholo¬ 
gists  were  so  concentrated  on  other  problems  more  closely  related  to 
the  original  research  on  classification  tests  that  little  opportunity  was 
left  to  cooperate  in  training  experiments. 

Some  of  the  work  of  aviation  psychologists  during  the  war  years 
was  relevant  to  training  experiments.  The  research  on  methods  of 
measuring  flying  skill  should  help  to  serve  as  a  foundation  for  experi¬ 
mental  work,  since  no  experiment  can  bo  better  than  tho  yardstick 
used  to  measure  its  results.  The  evaluation  of  effects  of  additional 
training  during  the  training  freeze  (chapter  10)  might  bo  considered 
to  be  semi-experimental,  but  since  the  conditions  of  this  additional 
training  were  designed  for  another  purpose,  there  was  no  opportunity 
for  establishing  suitable  control  groups.  Finally,  there  wero  tho  two 
studies  which  will  be  described  in  this  chapter.  Because  of  tho  con¬ 
ditions  under  which  they  were  conducted,  these  studies  cannot  bo 
taken  to  illustrate  the  best  principles  of  experimental  design.  Their 
description,  however,  including  tho  faults  wltich  could  have  been 
corrected  under  better  circumstances,  will  servo  to  illustrate  what  is 
meant  by  the  experimental  approach  to  training  problems. 

THE  EFFECT  OF  DIFFERENT  TRAINING  PLANES  IN  BASIC 

SCHOOL  ON  FLYING  SKILL  IN  ADVANCED  TRAINING" 

Tho  first  "experiment”  to  bo  described  involved  comparing  two 
groups  of  students  who  had  received  their  Basic  flying  training  in 
different  planes.  All  students  received  15  weeks  of  training  in  Basic 
sinco  they  were  involved  in  tho  temporary  training  freezes.  The 
groups  were: 

1.  Students  who  had  received  five  weeks  of  single-engine  training 
on  tho  I1T-13,  five  weeks  of  two-engino  training  on  tho  AT-10,  and 
five  weeks  of  single-engine  training  on  tho  AT-G.  Sinco  these  students 
received  some  of  their  Basic  flying  training  on  a  two-engino  plane,  they 
will  he  called  tho  tuv-engine  group. 

2.  Students  who  had  received  all  15  weeks  of  their  basic  phase  of 
flying  training  on  a  singlc-engino  plane,  tho  AT-6.  They  will  be 
called  the  singU-rngint  group. 

w  C»|it.  8.  C,  Frkkren  devK»l  the  ratine  form*  on  whkh  tho  raitnjti  of  student*  were  (retired  sod  eoor- 
dlnstrsl  the  etperlmrntsl  pr»erdure  employ.*!  with  supervisory  personnel  it  Moody  Army  Air  field. 
The  »t*llitl<  »l  ttul)  >1*  of  th«  *lnt»  wts  under  the  supervision  of  Set.  Chirk*  P.  Oenheruon. 
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The  students  in  the  two-engine  group  received  their  training  at  ono 
basic  school,  Shaw,  while  thoso  in  the  singlc-engino  group  received 
theirs  at  another,  Cochran.  Both  groups  received  their  advanced 
two-engine  training  on  the  TB-25  at  the  same  school  (Moody  Field). 
There  were  1G5  students  in  the  two-engino  and  84  students  in  tho 
single-engine  group. 

Starting  with  these  two  groups  the  study  was  set  up  to  answer  tho 
following  questions: 

1.  IIow  will  these  two  groups,  trained  on  different  types  of  planes 

in  basic  school,  compare  in  advanced  two-engine  training  on  tho 
TB-25?  *  • 

2.  If  one  group  shows  an  advantage  over  the  other  in  tho  early 
phuscs  of  training,  will  this  superiority  be  maintained  throughout  tho 
10-wcck  training  course? 

Uncontrolled  Variables 

This  experiment  suffered  from  certain  defects  because  of  the  fact 
that  the  two  groups  simply  happened  to  be  formed  during  tho  course 
of  changing  planes  in  the  training  program  ami  were  not  deliberately 
set  up  as  experimental  groups.  In  the  first  place,  tho  comparison 
between  students  with  all  of  their  training  on  the  AT-G  and  thoso 
with  training  on  three  different  types  of  planes,  the  BT-13,  AT-10, 
and  AT-6,  is  not  tho  most  relevant  comparison  that  could  bo  made. 
The  effects  of  training  on  a  two-engine  plane  arc  mixed  up  with  thoso 
of  having  training  divided  among  three  different  types  of  planes.  It 
would  probably  be  more  meaningful  to  compare  a  group  with  all  of 
its  training  on  the  two-engine  AT-10  with  unother  ono  with  all  of  its 
training  on  the  singlc-engino  AT-6. 

The  two  groups  arc  not  matched.  The  fact  that  all  of  the  students 
at  one  school  were  given  one  type  of  training  and  all  of  tho  students 
at  the  other  school  were  given  another  type  of  training  is  good  becauso 
it  rules  out  the  possibility  that  either  of  tho  schools  selected  a  special 
type  of  student  for  the  special  typo  of  training.  Insofar  os  could  bo 
determined  there  were  no  special  factors  enusing  better  students  to  bo 
sent  to  one  school  than  to  tho  other.  Experience  has  shown,  however, 
that  segregation  of  students  into  groups  in  tho  Training  Command  is 
not  purely  a  random  matter.  Thcro  is  somo  tendency  for  students 
entering  at  a  given  timo  and  place,  or  having  other  features  in  com¬ 
mon,  to  remain  together  so  that  groups  may  differ  far  more  than 
would  be  expected  by  chanco.  Therefore,  in  designing  an  experiment, 
tho  safest  thing  to  do  is  to  select  tho  two  groups  in  auch  a  way  that 
they  arc  either  perfectly  randomized  or,  better  still,  matched  for 
any  mensurable  factors  that  might  affect  tho  results.  In  this  caso, 
the  ideal  thing  would  have  been  to  build  up  tho  two  groups  out  of 
pairs  of  students  who  had  no  flying  experience  before  primary,  had 
equal  stnnincs,  and  lmd  received  the  same  flying  grudes  at  the  same 
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primary  school.  The  correlation  between  the  scores  of  the  members 
of  each  matched  pair  would  reduce  the  standard  error  of  the  difference 
between  the  two  groups,  and  hence  increase  the  discrimination  of 
the  experiment. 

Sinco  tho  two  groups  came  from  different  schools,  thcro  is  a  possi- 
bility  that  differences  between  them  may  have  been  caused  by  differ* 
cnees  in  tho  level  of  instruction  at  these  schools  rather  than  by  the 
types  of  planes  employed.  It  would  havo  been  desirable  to  have 
divided  ono  Basic  school  into  two  squadrons  with  instructors  as  com¬ 
parable  us  possible.  Then  Squadron  A  should  havo  taught  the  two- 
engino  group  and  Squadron  B  the  singlc-cngino  group  for  ono  class 
and  tho  two  groups  have  been  reversed  (Squadron  A  teaching  single- 
ongino  and  Squadron  B  two-engino  students)  for  tho  next  class. 
Although  control  procedures  of  this  kind  may  seem  inconvenient, 
they  save  time  and  money  in  tho  long  run  by  allowing  dccisivo  results 
to  bo  achieved  moro  quickly  with  fewor  students  tested. 

Procedure  Followed  at  the  Advanced  Two-Engine  School 

Tho  way  in  which  tho  two  groups  were  originally  derived  was  not 
under  experimental  control,  but  after  they  arrived  at  tho  Advanced 
two-engino  school  every  effort  was  made  to  study  them  under  com¬ 
parable  conditions. 

Each  instructor  was  assigned  insofar  as  possiblo  tho  samo  propor¬ 
tion  of  students  from  each  group.  Tho  performance  of  tho  students 
was  measured  in  the  following  way:  At  tho  conclusion  of  each  wcok 
of  training,  each  insti actor  was  required  to  rank-^jrdcr  his  students 
on  12  aspects  of  proficiency.  Tho  categories  used  wero  taken  from 
tho  grado  slip  and  hcnco  were  ones  which  tho  instructors  wore  accus¬ 
tomed  to  observe.  They  covered  8  general  aspects  of  flying  and  4 
general  characteristics  of  each  student’s  work  as  follows: 

Taxiing  Formation 

Take-off  and  climb  Night  landings 

Stalls  Attitude  toward  work 

Slow  flying  Technique 

Single-engine  work  Progress 

Landings  Judgment 

Tho  instructors  were  warned  to  guard  against  tho  common  error  of 
overlooking  tho  few  weak  points  of  good  students  or  tho  few  strong 
points  of  poor  st  udents  in  making  their  ratings.  They  wero  instructed 
to  rate  their  students  on  each  item  separately  guarding  against  the 
common  tendency  (called  “halo”  effect)  to  let  tho  rating  given  a 
student  on  ono  item  affect  tho  rating  given  him  on  another.  Thoy 
were  also  instructed  to  keep  tho  items  on  tho  scale  in  mind  when 
flying  each  mission  so  that  they  would  observo  os  many  things  as 
possiblo  on  which  to  baso  tho  ratings  given  at  tho  end  of  each  week. 

By  assigning  equal  proportions  of  each  group  to  each  instructor  and 


requiring  him  to  rank -order  his  students,  the  most  sensitive  possible 
subjective  measure  was  obtained.  This  procedure  avoided  one  of  tho 
chief  difficulties  inherent  in  subjective  grades,  namely  the  difference  in 
the  absolute  standards  of  various  instructors,  and  allowed  each  one  to 
make  relative  judgments.  It  also  forced  an  adequate  distribution. 
The  rank-order  of  any  given  instructor  will  be  influenced  by  whether 
lie  happens  to  get  the  best  or  poorest  students  from  one  of  the  groups; 
the  average  rank-order  of  the  whole  group,  however,  will  reflect  its 
proficiency. 

Iu  addition  to  rank-ordering  their  students  each  week  on  the  items 
contained  in  the  rating  form,  the  instructor  and  supervisory  personnel 
were  required  to  fill  in  a  short  questionnaire  nt  the  end  of  the  10-week 
course  in  which  they  gave  their  over-nil  impressions  of  the  relative 
proficiency  of  the  two  groups  of  students  with  special  reference  to 
aspects  of  training  in  which  cither  group  was  superior  and  any  change 
in  the  relative  performance  of  the  two  groups  from  beginning  to  end 
of  tho  course. 

Results 

The  data  derived  from  this  study  were  analyzed  in  the  following 
way.  Each  instructor's  students  wero  divided  into  two  groups:  those 
in  the  higher  half  of  the  rank-order  and  those  in  tho  lower  half  of  tho 
rank-order.  When  an  instructor  had  an  odd  number  of  students,  tho 
middle  case  was  discarded.  In  tablo  13.1  arc  presented  figures  con¬ 
trasting  the  percentage  of  students  in  each  of  the  two  groups  (single- 
engine  group  and  two-engine  group)  who  were  rated  in  the  upper  half 
by  their  instructor  on  each  of  the  items  rated  at  the  completion  of  each 
week  of  advanced  training.  The  reliability  of  the  differences  on  each 
of  the  items  nt  each  week  of  training  is  also  presented.  Tho  snmo 
data  for  two  items — Single-Engine  Work  and  Technique — arc  presented 
graphically  in  figure  1. 

It  can  be  seen  that  having  had  basic  school  training  in  the  three 
different  types  of  planes,  one  of  which  was  two-engine,  is  a  definite 
advantage  during  tho  first  week  of  advanced  two-engine  training  in 
taxiing,  take-off  and  climb,  single-engine  w’ork,  progress,  and  technique. 
In  general,  these  arc  the  aspects  of  flying  in  which  two-engine  training 
differs  most  from  single-engine  trnining.  Furthermore,  it  will  be  seen 
that  these  differences  have  been  substantially  reduced  by  the  end  of 
the  ninth  w’eek  of  Advanced  two-engine  training,  although  tho  ad¬ 
vantage  is  still  in  favor  of  those  students  who  were  trained  in  a  two- 
engine  plane  in  Basic  school.  For  the  first  week  of  training  the 
differences  on  all  fivo  of  these  items  nre  of  a  size  which  would  ho 
expected  by  chauco  alone  less  than  one  time  in  100.  At  the  end  of 
the  ninth  week  the  difference  in  taxiing  would  still  be  expected  by 
chance  less  than  one  time  in  100  and  that  in  single-engine  procedure 
only  three  times  in  100. 
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On  the  other  aspects  of  flying  and  the  other  two  general  character¬ 
istics  of  the  students’  work  rated,  the  differences  during  the  first  week 
of  two-engine  advanced  training  wero  not  statistically  reliable.  The 
differences  for  the  same  items  were  also  not  statistically  reliable  during 
tho  ninth  week  of  advanced  two-engino  training  except  for  the  item 
on  slow  flying.  For  this  item,  tho  two  groups  with  diverso  Basic 
training  showed  no  difference  during  the  first  week  of  Advanced  two- 
engine  training  but  showed  a  large  ndvantago  during  tho  ninth  week 
of  training  in  favor  of  the  students  who  had  been  trained  in  a  two- 
engine  plane  in  basic  school. 

The  subjective  opinions  of  supervisors  and  instructors  coincided 
well  with  the  results  obtained  from  analyzing  the  data.  Some  of  the  1 
comments  on  general  pilot  ability  and  chnngo  in  relative  performance 
of  the  two  groups  are  quoted  below. 

The  students  of  the  two-engine  group  acquired  the  techniques  and  procedures 
more  rapidly  mid  with  less  apparent  effort.  They  had  no  trouble  with  single- 
engine  operation,  flew  patterns  better  and  more  accurately  and  had  no  trouble  | 
with  checks  while  in  the  pattern.  In  general,  they  acquired  twin-engino  "know¬ 
how”  more  rapidly  and  this  reflected  on  their  general  pilot  ability. 

Students  of  the  two-engine  group  started  out  with  more  on  the  ball  and  cheeked 
out  sooner.  Students  of  the  single-engine  group  used  up  maximum  permissible 
dual  time,  but  did  satisfactory  work  later. 

Conclusion 

i 

This  study  indicated  that  the  type  of  plane  in  which  students  re-  , 
ccivc  their  basic  training  does  affect  their  performance  in  advanced  ! 
training.  Students  who  received  somo  of  their  training  in  a  two-  , 
engino  plane  (the  AT- 10)  in  basic  school  were  more  proficient  in 
taxiing,  take-off  and  climb,  single-engine  work,  and  technique  during  i 
the  early  weeks  of  their  advanced  two-engino  training  than  students 
who  received  all  of  their  basic  training  in  a  single-engine  plane  (the  1 

AT-6).  These  are  the  aspects  of  flying  in  which  two-engino  training  ! 

is  most  different  from  single-engine  training.  With  continued  two-  ; 
engine  training,  the  initial  superiority  of  tho  students  who  were 
trained  in  a  two-engine  plane  in  basic  school  decreased  but  still 
tended  to  remain  above  the  proficiency  of  students  who  had  received  : 
no  training  in  a  two-engino  plane  at  tho  basic  level. 

Though  those  results  seem  reasonable  and  arc  probably  correct,  it 
was  impossible  to  bo  completely  certain  that  tho  two  groups  were 
either  completely  randomized  or  matched  before  the  experiment  or 
to  control  the  quality  of  instruction  at  the  basic  schools.  This 
leaves  the  possibility  that  the  difference  between  the  two  groups  may 
lmvo  been  produced  either  by  systematic  differences  in  the  aptitude 
of  tho  students  originally  assigned  to  them  or  to  differences  in  the 
quality  of  instruction  nt  the  two  schools  where  they  received  their 
basic  flying. 
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Effect  of  AT-6  at  Basic  on  Proficiency  at  Single-Engine  Advanced 

A  similar  experiment  was  set  up  at  the  advanced  singlc-engino  school 
at  Craig  Field,  Selma,  Ala.  Some  students  entering  class  45-A  at 
that  school  had  received  their  basic  training  on  t he  BT- 13  while  others 
had  received  their  basic  training  on  the  AT-6.  Unfortunately,  there 
were  only  16  students  in  the  AT-6  group  in  that  class  and  special 
conditions  at  the  school  made  it  impractical  to  conduct  nil  experiment 
on  the  following  and  only  remaining  mixed  class.  In  general,  the 
results  showed  the  same  trend  ns  that  found  in  the  study  roported 
above.  Initially,  tho  students  trained  on  the  AT-6  at  basic  school 
wero  considerably  superior  to  those  receiving  their  basic  training  on 
the  BT-13.  As  training  progressed  the  superiority  of  thoso  students 
decreased  although  performance  still  remained  above  that  of  tho  other 
group  on  most  items  rated.  The  number  of  students  involved, 
however,  was  too  small  to  make  the  results  conclusive. 

EVALUATION  OF  THE  SELF-REFLECTING  OPTICAL  SKEET 
SIGHT  AS  A  FIXED  GUNNERY  TRAINING  AID  n 

Under  tho  supervision  of  the  Training  Aids  Officer  of  AIoo  Army 
Air  Field,  Victoria,  Tex.,  a  self-reflecting  optical  sight  was  designed  for 
attachment  to  the  conventional  shotgun  for  use  in  teaching  the  sight 
picture  for  air-to-air  fixed  gunnery.  The  sight  designed  gavo  tho 
student,  firing  sheet,  tho  same  sight  picture  (described  in  tho  first  pert 
of  chapter  11)  that  he  sees  later  in  fixed  gunnery  truining  when  making 
passes  with  an  AT-C  plane  at  an  aerial  towed  target.  Increasing  tliis 
important  aspect  of  tho  similarity  between  tho  two  tosks  should 
increase  the  transfer  of  training  from  shotgun  to  fixed  gunnery  firing. 

In  order  to  evaluate  this  newly  developed  sight  os  a  training  aid, 
the  Training  Aids  Officer  had  each  of  three  successive  classes  (44-1-G, 
44-1-J,  and  44-1-K)  split  into  two  randomly  selected  groups:  a  control 
group  and  an  experimental  group.  The  control  group  was  given  its 
sheet  training  as  usual  with  the  conventional  shotgun.  The  experi¬ 
mental  group  fired  the  same  number  of  rounds  of  sheet  using  shotguns 
equipped  with  the  optical  sight.  This  training  took  plnco  during  tho 
advanced  phase  of  pilot  training.  When  these  students  graduuted  to 
gunnery  training,  three  students  from  the  control  group  and  three 
students  from  the  experimental  group  were  assigned  to  each  gunnery 
instructor.  The  selection  of  these  groups  of  three  for  assignment  was 
random. 

Results 

After  tho  results  wero  secured,  personnel  of  the  Pilot  Project  were 
asked  to  analyzo  the  air-to-air  fixed  gunnery  scores.  Means,  standard 
deviations,  and  critical  ratios  were  determined  for  each  subsection  of 

n  Lt.  William  fc.  Oalt  and  P*».  John  O.  O Inara  art  mponslbl*  for  th*  ilatUt  kal  nnaljriU  of  Ibo  data  from 
tblj  axperlmcnt  and  for  tho  ovoltuilon  of  Ibo  rroulta. 
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each  class  and  for  all  classes  combined.  Table  13.2  presents  these 


data. 

Tadi.e  13.2. — Effect  of  using  different  type*  of  shotgun  sight  during  sheet  shooting 
training  on  subsequent  performance  in  air-to-air  fixed  gunnery 
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Sight  used  In  sheet  training 
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17 
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44-l-K  (2)  . 

Optical . 

34 

IS.  67 

11  It 

1 

!* 

» 

.09 

« 

44-l-K  (2) . 

Conventional . 
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1190 

}  111 
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.01 
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Conventional . 
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11.63 

p  Probability  or  obtaining  by  chance  alone  a  difference  of  this  site  In  favor  of  the  croup  trained  on  tha 
optical  ilcbt.  A  "I*”  ol  0.01  means  that  th«  observed  dlUcre  not  would  bo  expected  to  occur  by  chance  only 
one  time  In  100. 

i  The  difference  was  in  favor  of  the  group  trained  on  the  crave ritJonal  tight. 


It  will  bo  seen  from  the  table  that  the  mean  percent  hits  in  air-to-air 
fixed  gunnery  of  the  145  students  who  Were  trained  with  the  self- 
reflecting  optical  skcct  sight  is  higher  *han  the  mean  percent  hits  of 
144  students  who  were  trained  with  the  conventional  shotgun.  The 
difference  in  favor  of  the  group  trained  with  tho  optical  sight  is  of  a 
sizo  which  would  bo  expected  to  occur  by  chnnco  less  than  one  time  , 
in  100.  The  difference  of  3.10  in  the  means  of  tho  two  groups  gives  j 
tho  group  trained  with  tho  optical  sight  an  averago  of  11  percent  ; 
moro  hits  in  air-to-air  gunnery  than  the  control  group.  These  data 
strongly  indicato  that  tho  3clf-rcflccting  optical  skcct  sight  is  a  valu¬ 
able  fixed  gunnery  training  aid. 

IIow  Design  of  Experiment  Might  Have  Been  Improved 

In  general,  tho  design  of  this  experiment  was  quite  good.  Still 
tetter  results  might  havo  been  secured,  however,  if  tho  plan  had  been 
lcflncd  in  two  ways. 

Tho  groups  should  havo  been  matched  on  tho  basis  of  flying  skill.  1 
In  this  experiment  tho  flying  ability  of  tho  experimental  and  the  con¬ 
trol  groups  was  probably  made  approximately  equal  by  assigning 
tho  students  to  tho  two  groups  in  a  purely  random  manner.  When 
selection  is  made  in  this  way,  ono  will  expect  a  certain  amount  of  ' 
difference  in  tho  average  level  of  flying  ability  of  tho  two  groups  to 
occur  by  chance.  If  tho  groups  aro  small,  liko  those  involved  in  i 
each  of  tho  separato  classes,  these  chance  differences  may  bo  appreci¬ 
able;  if  they  aro  largo,  liko  tho  total  for  all  of  tho  classes  involved  in 
tho  experiment,  tho  chance  differences  will  beeomo  relatively  much 
less  important.  Sinco  tho  results  for  all  of  tho  classes  combined 
showed  a  difference  of  the  magnitude  which  would  bo  cxpocte  1  to 

286  *  •  •  i 


occur  by  clianco  less  than  one  time  in  100,  it  is  snfo  to  concludo  that 
the  different  types  of  training  produced  a  real  difference  in  tho  two 
groups  of  s’.udcnts. 

If  one  loAs  at  the  separate  results  on  each  class,  however,  ono 
will  see  that  there  is  a  revers'd  in  class  44-1-IC  (2).  In  this  ono  out 
of  tho  five  classes  tested,  students  who  had  been  trained  with  tho 
conventional  shotgun  did  better  than  those  v  ho  had  been  trained 
with  the  shotgun  equipped  with  tho  optical  sight.  Further  analysis 
of  these  results  makes  it  seem  likely  that  this  reversal  was  produced 
by  a  few  exceptionally  good  students  who  happened  to  bo  included 
in  the  group  trained  with  the  conventional  shotgun. 

Tho  chance  differences  in  tho  ability  of  tho  students  assigned  to 
the  two  groups  might  have  been  reduced  by  matching  them  on  tho 
basis  of  flying  grades  or  instructor  ratings  instead  of  relying  on  random 
selection  to  produce  groups  of  equal  flying  ability.  If  tho  groups 
had  been  matched  before  the  beginning  of  tho  experiment,  it  seems 
likely  that  statistically  reliable  differences  could  havo  been  secured 
without  having  to  test  so  many  students. 

Tho  fixed  gunnery  scores  should  havo  been  based  on  the  same  num¬ 
ber  of  rounds  for  all  students.  In  this  experiment  the  percent  hits 
w as  based  on  all  of  the  rounds  fired.  Different  students  fired  different 
numbers  of  rounds.  Since  learning  occurs  tliroughout  fixed  gunnery 
training,  scores  of  tho  students  who  fired  more  rounds  will  on  the 
average  bo  expected  to  be  somewhat  liigker  than  tlioso  who  fired  fewer 
rounds.  Tliis  will  bo  a  disturbing  factor  diluting  tho  results  of  the 
experiment.  Sinco  the  number  of  rounds  fired  is  a  random  factor,  it 
cannot  account  for  the  differences  observed;  it  only  tends  to  reduce 
tho  reliability  of  those  differences.  This  difficulty  could  have  been 
avoided  by  tho  technique  (described  in  chapter  11  on  Fixed  Gunnery 
as  an  Objective  Meosuro  of  Flying  Skill)  of  basing  tho  scores  of  all 
students  on  the  same  number  of  rounds.  Tliis  would  have  increased 
the  sensitivity  of  the  experiment  and  tho  reliability  of  tho  results. 

SUMMARY 

Serving  as  consultants  on  the  scientific  design  of  experiments  to 
evaluate  training  methods  and  devices  should  ultimately  be  ono  of  the 
more  useful  functions  of  psychological  personnel  working  with  the 
Army  Air  Forces.  Such  emphasis  was  not  possible  during  tho  war 
because  of  the  concentration  of  psychological  personnel  on  tasks  more 
immediately  related  to  the  classification  testing  program.  Two 
minor  experiments,  however,  wero  undertaken  in  the  area  of  pilot 
training.  These  arc  briefly  described  to  iliustrato  tho  experimental 
approach  to  training  problems  even  though,  becauso  of  their  incidental 
nature,  it  was  not  possible  to  control  conditions  in  such  a  way  as  to 
secure  ideal  experimental  designs. 
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One  of  these  experiments  indicated  that  students  who  had  received 
part  of  their  boric  flying  training  on  a  two-engine  airplane  performed 
better  in  advanced  two-engine  training  than  those  who  had  received 
all  of  their  basic  training  on  a  single-engine  airplane. 

The  other  experiment  compared  the  normal  procedure  of  firing 
sheet  with  an  ordinary  shotgun  with  the  procedure  in  which  a  newly 
devised  self-reflecting  optical  sight  was  attached  to  the  gun.  The 
optical  sight  simulated  the  right  picture  wliich  the  students  would 
later  employ  in  air-to-air  fixed  gunnery.  It  was  found  that  the  stu¬ 
dents  trained  on  the  skcct  range  with  the  gun  equipped  with  the 
optical  sight  subsequently  made  reliably  better  scores  in  air-to-air 
firing  than  the  students  who  received  their  sheet  training  with  the 
conventional  typo  of  shotgun. 


CHAPTER  FOURTEEN 


Evaluation  and  Selection 
of  Flying  Instructors 

1st  Lt.  William  E.  Galt  and  Sgt.  Daniel  J.  Grier 


INTRODUCTION 

The  instructor  occupied  a  key  position  in  the  pilot-trnining  program 
because  the  qualities  of  one  instructor  influenced  muny  students.  Tho 
Pilot  Project  was  therefore  directed  to  concentrate  research  on  the 
evaluation  and  selection  of  flying  instructors.  The  main  objectives  of 
this  research  were:  the  determination  of  the  basic  interests  and  apti¬ 
tudes  of  good  flying  instructors;  tho  construction  of  experimental 
batteries  of  instructor  selection  tests  measuring  theso  basic  interests 
and  aptitudes;  the  development  of  scales  for  measuring  instructor 
proficiency,  and  the  use  of  these  scales  in  validating  the  tests  and  in 
studying  the  relationship  of  background  factors  to  teaching  proficiency. 
The  studies  dealing  with  this  research  arc  described  in  the  following 
seven  subsections: 

1.  Analysis  of  the  Abilities  Characteristic  of  Good  Flying  In¬ 
structors. 

2.  Studies  of  Existing  Methods  of  Instructor  Selection. 

3.  Survey  of  Possible  Criteria  for  Validation  of  Instructor  Selection 
Tests. 

4.  Development  of  a  Scale  for  Student  Rating  of  Flying  Instructors. 
o.  Analysis  of  Background  Factors  Related  to  Instructor  Success. 
0.  Construction  and  Validation  of  Batteries  of  Instructor  Selection 

Tests. 

7.  Summary  of  Results  and  Recommendations  for  Future  Work. 

ANALYSIS  OF  THE  ABILITIES  CHARACTERISTIC  OF  COOD 

FLYING  INSTRUCTORS 

Tho  first  phase  in  tho  development  of  techniques  of  instructor 
selection  was  a  job  analysis  of  tho  most  important  characteristics  of 
tho  good  flying  instructor.  Tho  studies  mndc  in  this  area  urc  outlined 
below. 

Some  Early  Work 

In  n  field  study  early  in  1943,  Maj.  Neal  E.  Miller  ami  Capt.  Donold 
E.  Super,  both  assigned  to  Psychological  Research  Unit  No.  1  at  tho 
time,  spent  G  weeks  living,  studying,  and  flying  with  tho  students  in 
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a  primary  Hying  ichool.  Later  on,  they  followed  up  the  students  by 
visiting  and  interviewing  them  toward  tho  end  of  their  basic  and 
advanced  training.  Tliis  work  furnished  background  information  on 
the  job  of  tho  flying  instructor. 

Prior  to  tho  establishment  of  Psychological  Research  Project 
(Pilot),  field  studies  of  the  characteristics  of  good  civilian  flying  in¬ 
structors  were  made  by  Psychological  Research  Unit  No.  2  under  the 
supervision  of  Capt.  Richard  P.  Youtz.  Tho  first  step  in  these 
studies  was  to  interview  supervisory  personnel  and  experienced  in¬ 
structors  on  the  qualities  which  they  considcied  the  most  important 
characteristics  of  good  instructors.  Supervisors  were  also  asked  to 
rate  their  instructors  and  then  describe  the  ways  in  which  tho  best 
diflfered  from  tho  poorest.  In  this  way  a  list  of  characteristics  con¬ 
sidered  important  in  differentiating  good  and  poor  instructors  was 
evolved. 

This  list  of  characteristics  of  good  instructors  was  used  as  a  basis 
for  developing  a  scale  on  which  supervisors  could  rate  various  ob¬ 
servable  aspects  of  instructional  ability.  Most  of  the  work  of  develop¬ 
ing  this  rating  scale  was  dono  at  Psychological  Research  Unit  No.  2,T* 
tho  officers  of  the  Pilot  Project  supplying  criticisms  and  a  few  sugges¬ 
tions  for  modification.  Most  of  tho  items  on  this  scalo  were  qualities 
of  good  instructors  but  a  few  referred  to  tho  results  of  good  instruction. 

Tho  Navy  approached  the  problem  similarly,  except  that  naval 
aviators  who  had  been  through  pilot  training  were  asked  to  write  out 
descriptions  of  tho  characteristics  of  their  best  and  poorest  instructors. 

In  this  way,  data  were  obtained  on  93  good  instructors  and  78  poor  • 
instructors.  The  characteristics  considered  important  in  differenti¬ 
ating  the  goed  from  the  poor  instructors  wero  rank-ordered  in  accord-  j 
anco  with  tho  percentage  of  times  that  each  trait  was  mentioned. 

Examples  of  Good  and  Poor  Techniques  of  Teaching  Flying 

A  considerable  number  of  examples  of  good  techniques  in  teaching 
flying  was  available  from  a  collection  made  by  Maj.  Neal  E.  Miller  in 
tho  spring  of  1942  from  instructors  attending  a  refresher  course  at  the 
Central  Instructors  School,  Maxwell  Field,  Ala.  This  collection  was 
rounded  out  by  Lt.  Wallace  Nygard  and  Sgt.  Daniel  J.  Grier,  who 
collected  further  examples  of  both  good  and  bad  techniques  from  in¬ 
structors  in  the  field  and  from  recently  graduated  pilots  attending  tho 
Central  Instructors  School  at  Randolph  Field.  Tho  organized  file 
of  such  examples  furnished  the  materials  for  a  50-itein  check  list  of 
ways  in  which  teachers  could  most  improve  their  flying  instruction. 
Tho  items  most  frequently  checked  on  the  list  wero  used  os  a  basis 
for  constructing  instructor  rating  scales. 

*  Capt.  John  T.  Pafley  tv  tho  major  contributor  In  Oil*  work,  lie  was  assisted  by  the  following  otneer* 
and  enlisted  men:  M*J.  M.  I*.  Crawford,  Capt.  Richard  P.  Youtr,  Capt.  W.  A.  McClelland,  Lt.  J.  T. 
Cowles,  Lt.  J.  Well*,  Lt.  C.  P.  Frochlich,  Lt.  R.  J.  Keller,  Lt.  I.  E.  Farber,  Lt.  C.  II.  raltenon,  and 
S/P ft.  I.  Ilobblna, 
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The  most  frequent  suggestions  of  recently  graduated  students 
centered  around  tho  following  general  aspects  of  instructing: 

1.  Not  using  ridicule ,  sarcasm,  or  abusive  language. — Uso  of  oaths, 
ridicule,  or  sarcasm  at  a  timo  when  the  student  was  olready  under- 
confident,  tense,  or  confused  was  a  frequent  criticism  by  students 
of  their  instructor’s  behavior.  Students  rcpoiied  that  this  typo  of 
behavior  tended  to  incrcaso  their  difficulties. 

2.  Ability  to  express  himselj. — Their  instructor’s  failuro  to  givo  a 
clear  enough,  explanation  beforo  and  after  demonstration  was  also  a 
frequent  criticism.  Tho  students  reported  that  they  had  difficulty 
bccauso  they  did  not  know  what  they  wero  supposed  to  observo  or 
try  to  do,  or  why  they  wero  doing  it. 

3.  Analysis  oj  errors. — Tho  students  said  that  their  instructors 
wero  not  specific  enough  in  telling  them  exactly  what  was  wrong  in 
their  maneuvers. 

4.  Hiding  controls. — Tho  students  reported  that  beforo  solo  thoy 
often  did  not  have  tho  opportunity  to  practico  stalling,  landing,  and 
getting  out  of  difficulties  by  themselves  becauso  their  instructors 
took  over  tho  controls  on  too  slight  a  provocation. 

5.  Interest  in  teaching  flying. — A  frequent  criticism  was  that  tho 
instructor  lacked  interest  in  tho  job  of  teaching  flying.  . 

6.  Sclj -confidence  —  Not  ajraid  oj  plane  or  student. — Students 
reported  that  their  instructor  somotimes  feared  a  particular  maneuver 
or  had  bad  flying  habits  which  he  passed  on  to  them. 

From  tho  examples  of  good  and  bad  techniques  of  teaching  flying 
a  check  list  of  50  items  was  prepared  by  Lt.  AVnllnco  Nygurd  and  Sgt. 
Daniel  J.  Grier  of  tho  Pilot  Project.  This  check  list  was  administered 
to  304  recent  Advanced  school  graduates  in  class  44-7  at  Central 
Instructors  School,  Randolph  Field,  Tex.,  and  to  320  students  in 
class  44-8.  Tho  first  group  of  students  was  given  tho  check  list 
after  they  had  attended  a  number  of  CIS  courses;  tho  second  group 
was  tested  beforo  they  had  received  ony  instructor  training.  Th<s 
students  wero  asked  to  check  tho  10  items  which  thoy  felt  would 
most  improvo  tho  instructional  ability  of  their  advanced  school 
instructors. 

Tho  two  groups  gavo  relatively  similar  responses.  Sinco  tho  second 
and  larger  group  was  tested  beforo  any  indoctrination  at  Central 
Instructors  School,  their  results  may  be  taken  ns  most  representative 
of  tho  opinions  of  tho  averngo  student.  Tho  responses  wero  tabulated 
separately  for  graduates  of  smglc-  and  two-engino  schools.  Sinco 
only  minor  differences  were  found,  these  results  wero  combined. 

Tnblo  14.1  lists  in  order  of  importance  the  10  items  most  frequently 
selected  by  the  students  who  had  just  entered  Central  Instructors 
School  and  not  yet  received  any  indoctrination  thero.  Tho  percentage 
of  students  who  selected  the  item  ns  being  umong  the  first  10  in  which 
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their  advanced  school  instructors  could  have  shown  the  most  improve* 
ment  is  shown  in  the  first  column. 

Tajblh  14,1, — Items  on  which  advanced  school  graduates  thought  it  most  important 

/or  their  instructor  to  improve 

Dosed  on  320  recent  graduates  from  Single-  and  TwoEngine  Schools  (Entering 

students  in  CIS  Class  44-8) 


rprernt*** 
■elect  ln( 
Item 
among 
first  10 
out  of  • 
list  of  60 


Rink 

order 


I  wish  that  my  Instructor  would— 


Pertt  of 
06 
60 
66 
M 
to 

43 


41 

36 

30 

Vi 


1 

2 

3 

4 
6 

5 


7 

8 

0 

10 


Trll  me  Immediately  when  I  do  somethin*  wrong. 

Illustrate  more  frequently  how  the  maneuvers  (sequences)  we  used  In  combat. 

1'iit  greater  tenchliic  emphasis  on  perfuriniiiE  In  emergencies  and  using  common  sens*. 

More  dearly  outline  every  maneuver  that  student  a  should  practice  on  solo  flights. 

lie  more  thorough  In  analysis  of  errors. 

Kxphiln  on  the  ground  more  in  detail  the  what,  why,  and  how  of  the  maneuver, 
rather  than  leach  hy  the  "now  you  follow  through"  demonstration  method  so 
exclusively. 

(live  verbal  Instructions  far  enough  ahead  of  a  maneuver  to  allow  plenty  of  time  for 
executing  Die  maneuver. 

Oi\  e  me  more  Instruction  In  how  a  sequence  should  be  done,  Instead  of  merely  point¬ 
ing  out  the  errors. 

Have  inure  standardisation  of  his  Instruction  w  ith  other  Instructor*. 

Take  more  time  to  tie  In  each  maneuver  (sequence)  with  other  maneuvers  I  hare 
already  learned. 


The  items  in  the  check  list  arc  specific.  Stating  them  in  more 
general  terms,  it  can  he  seen  that  the  students  felt  that  their  instruc¬ 
tors  were  deficient  in  giving  explanations  and  in  expressing  themselves, 
in  analysis  of  errors,  and  in  adapting  their  methods  to  the  individual 
student. 

Qualities  Considered  to  Be  Most  Important  Characteristics  of  Good 
Flying  Instructors 

Further  studies  dealt  moro  directly  with  the  qualities  which  super¬ 
visors,  instructors,  and  students  considered  tho  most  important 
characteristics  of  the  good  flying  instructor. 

On  the  basis  of  examples  of  good  and  poor  teaching  techniques, 
interviews  with  supervisors,  instructors  and  students,  and  experience 
gained  in  collecting  examples  of  flying  instruction  from  good  and  poor 
instructors,  lists  of  qualities  important  for  flying  instruction  were 
drawn  up.  One  of  these  lists  of  25  qualities  was  used  in  3  studies  by 
tho  Pilot  Project.  One  hundred  and  forty-one  students  in  3  primary 
schools,  250  students  in  2  basic  schools,  and  304  students  in  an  ad¬ 
vanced  singlc-cngino  school,  an  advanced  two-enginc  and  a  transition 
school  were  asked  to  check  the  5  most  important  instructor  qualities 
of  tho  25  qualities  listed* 

To  tho  results  of  these  studies  may  bo  added  two  other  similar 
ones.  In  one  study  Capts.  Richard  P.  Youtz  and  John  T.  Dailoy  of 
Psychological  Research  Unit  No.  2  had  71  primary  school  supervisors 
placo  in  rank  order  the  qualities  important  in  a  flying  instructor.  In 

292 


the  other  study,  a  check  list,  paralleling  the  items  of  the  rating  scalo 
developed  by  Psychological  Research  Unit  No.  2,  was  mado  up  and 
presented  to  309  instructors  at  4  advanced  flying  schools  by  Capt. 
Stanford  C.  Erickson  and  T/Sgt.  Robert  R.  Blake.  Tho  instructors 
ranked  the  qualities  in  order  of  importance  by  giving  tho  quality  most 
important  for  a  good  instructor  a  rank  of  “  1,"  the  next  most  important 
quality  a  rank  of  “2,”  and  so  on  down  to  the  least  important  quality 
which  was  assigned  a  rank  of  “  14." 


Table  14.2. — The  six  qualities  most  important  for  flying  instructors 
(Arranged  in  the  Order  of  Importance  Assigned  to  Them) 


As  judged  bp  superrtsors  (Primary  school)  N-71 

1.  Interest  in  teaching  flying 

2.  Analysis  of  errors  * 

3.  Adapting  methods  to  individual  * 

4.  Patience  and  self-control 1 2 3 4 

5.  Ability  to  express  himself 1 

6.  Flying  ability  1 

As  Judged  bt  students  (Paste  school)  N**ttO 

1.  Analysis  of  errors 1 

2.  Patience  and  self-control 1 

3.  Flying  ability  ‘ 

4.  Adapting  methods  to  individual 1 

5.  Not  using  ridicule,  sarcasm  or  abu¬ 

sive  language 

6.  Ability  to  express  himself 1 

As  Judged  bp  students  (Adeaneed  and  Transition 
school)  N-30S 

1.  Patience  and  self-control 1 

2.  Not  riding  controls 

3.  Adapting  methods  to  individual 1 

4.  Flying  Ability  * 

6.  Ability  to  express  himself  * 

0.  Not  using  ridicule,  sarcasm  or  abu- 
sivo  language 


As  Judged  bp  students  ( Primers  school)  tf~lll 

1.  Analysis  of  errors  * 

2.  Patience  and  self-control 1 

3.  Flying  ability  1 

4.  Ability  to  express  himself 1 

5.  Adapting  methods  to  individual1 
0.  Interest  in  teaching  flying 

As  Judged  bp  Instructors  (A  dra  need  school)  If  <*90$ 

1.  Interest  in  teaching  flying 

2.  Adapting  methods  to  individual1 

3.  Analysis  of  errors* 

4.  Ability  to  express  himself* 

5.  Flying  ability  * 

0.  Patience  and  self-control 1 

Ouolllles  correlating  most  hlghlp  with  anchor  tens  of 
students’  rating  seals  *  If-tW 

1.  Flying  ability  * 

2.  Adapting  methods  to  individual  * 

3.  Analysis  of  errors  * 

4.  Ability  to  express  himself 1 

6.  Use  of  flight  time 

0.  Patience  and  self-control 1 


*  Placed  among  (he  first  six  In  Important  by  alt  six  groups. 

*  Placed  among  tho  first  six  In  Importance  by  flv«  out  of  six  groups. 

*  There  were  two  Items  of  a  general  nature,  namely,  "KfTcctb  enoss  of  un-theg  round  leaching"  and  “Coo- 
duct  as  an  officer,"  which  correlated  more  highly  with  '.he  onchor  Item  of  the  Students'  listing  Scale  than 
Items  3,  4,  8,  and  8.  See  table  14.4  for  complete  matrix  of  Intcr-correlatloDf, 


The  six  qualities  considered  most  important  by  the  groups  in¬ 
volved  in  each  of  these  studies  arc  listed  in  table  14.2  in  order  of  tho 
importance  assigned.  Included  in  this  table  arc  also  the  items  of  tho 
Students’  Rating  Seale  developed  by  the  Pilot  Pi oject  which  correlated 
most  highly  with  the  anchor  item  of  the  scale,  “Effectiveness  in  put¬ 
ting  flying  training  across.”  There  is  close  agreement  among  super¬ 
visors,  instructors,  and  students  at  nil  levels  of  training.  Tho  follow- 
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ing  four  qualities  were  placed  in  the  first  six  by  nil  five  groups:  adapting 
methods  to  the  individual,  patience  and  selj-control,  ability  to  express 
himsclj,  and  flying  ability.  Analysis  of  errors  was  placed  among  tho 
first  six  in  importance  by  four  of  the  five  groups.  These  qualities  also 
correlated  highly  with  the  anchor  item  in  the  Students’  Rating  Scale. 

Study  of  Returned  Combat  Pilots  n 

lit  order  to  determine  factors  which  arc  especially  important  in 
making  tho  returned  combat  pilot  a  successful  instructor,  officers  of 
tho  Pilot  Project  interviewed  all  returned  combat  pilots  instructing 
at  the  advanced  two-cnginc  school  at  Brooks  Field,  Tex.  Tho  flight 
and  squadron  supervisors  of  these  instructors,  the  commanding  officer, 
and  the  director  of  training  at  Brooks  Field  were  also  interviewed  to 
get  their  observations  on  tho  adjustment  of  theso  men  to  tho  in* 
structor  program.  Pilot  returnees  attending  various  instructor 
schools  such  as  tho  AAF  Central  Instructors  School,  Randolph  Field, 
Tex.,  AAF  Instructors  School  (Instrument  Pilot),  Bryan  Army  Air 
Field,  Bryan,  Tex.,  AAF  Instructors  School  (Pilot  4-Enginc,  B-24), 
Smyrna  Army  Air  Field,  Smyrna,  Tcnn.,  nnd  Instructors  School 
(Pilot  4-Enginc,  B-17),  Lockboumo  Army  Air  Base,  Columbus, 
Ohio,  were  also  interviewed. 

Theso  interviews  confirmed  the  general  findings  of  the  psychological 
research  projects  at  tho  Bombardier  and  Navigator  Central  In¬ 
structors  Schools  that  problems  of  morale,  personality,  and  emotional 
adjustment  were  of  especial  importance  in  determining  whether  or 
not  a  combat  returnee  would  make  a  good  instructor.  The  problems 
of  adjustment  faced  by  theso  men  were  similar  to  those  of  returned 
bombardiers  nnd  navigators  as  described  in  tho  reports  of  tho  Bom- 
bnrdicr  nnd  Navigator  Projects.*®  They  were  on  tho  whole,  however, 
considerably  less  severe. 

Tho  moro  adequate  adjustment  of  pilot  returnees  to  instructor 
training  was  to  be  explained  in  pnrt  by  the  rapid  advances  in  pilot 
technique  which  had  occurred  since  these  men  were  originally  trained 
especially  in  two-engine  nnd  instrument  flying.  Tho  men  realized 
tho  value  of  the  new  techniques  nnd  were  eager  to  learn.  They  were, 
however,  me  rc  interested  in  the  training  itself  than  in  becoming  adept 
as  instructors.  Tho  generally  good  facilities  at  tho  pilot  instructors 
schools  and  the  superior  status  of  the  pilot  in  the  Army  Air  Forces 
seemed  to  bo  other  factors  contributing  toward  tho  generally  better 
morale  of  theso  men  than  of  returned  bombardiers  and  navigators. 

The  chief  difficulties  of  returned  pilots  were  found  to  bo  emotional 
and  to  center  about  tho  following  factors: 

1.  Dislike  oj  ground  discipline  and  the  details  of  administrative  red 

These  studlei  were  inode  by  Mu]  N Ml  E.  Miller,  Cupt.  Richard  P.  Youtf,  Lt.  William  E.  Oolt,  T/Sgt. 
Robert  H.  Moke  and  8/?gt.  Irving  Robbing. 

*  I’tycboloflca!  Research  In  Bombardier  Training,  Psychological  Research  in  Navigator  Training. 
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tape  to  which  they  had  not  been  accustomed  in  combat  zones.  Bring  sent 
to  the  instructors  school  was  like  being  demoted  to  cadet  status. 

2.  Dislike  for  the  routine  schedule  oj  continuous,  monotonous,  hard 
work.  In  combat  they  had  been  accustomed  to  spurts  of  difficult, 
dangerous  work  followed  by  periods  of  relative  inactivity  during  which 
they  could  do  pretty  much  as  they  pleased.  Some  felt  they  had  al¬ 
ready  done  their  part  in  the  war  and  were  entitled  to  a  soft  job. 

3.  Difficulty  oj  changing  to  a  diffierent  kind  oj  Jlying.  They 
resented  the  many  checks  which  were  a  routine  part  of  instructing  but 
which  were  not  adhered  to  in  combat.  Some  of  the  men  had  lost 
certain  aspects  of  precision  necessary  in  instructing.  Others  objected 
to  gliding  the  un armored  and  lighter  training  planes  so  much  moro 
slowly  than  they  had  been  accustomed  to  gliding  their  heavier  planes 
in  combat.  Thero  was  the  attitude  that  they  had  “been  there  and 
knew”  and  some  expressed  resentment  about  beginning  all  over  again 
at  the  bottom  and  taking  orders  from  men  who  had  not  been  in 
combat  and  who  were  sometimes  of  lower  rank. 

4.  Reluctance  to  let  students  fly  the  plane.  Quite  a  few  of  theso 
instructors  felt  that  they  were  losing  their  flying  skill  and  not  getting 
any  fun  out  of  instructing  because  the  students  did  all  of  tho  flying. 
Frequent  narrow  escapes  in  combat  made  others  uneasy  when  a  stu¬ 
dent,  whom  they  did  not  trust  at  the  controls,  mndo  various  mistakes, 
such  ns  coming  in  with  one  wing  low,  or  in  doing  maneuvers,  such  as 
single-engine  landings  in  a  two-engine  plane,  which  had  been  added 
to  the  training  schedule  sinco  these  instructors  had  been  trained. 
Their  uneasiness  made  it  very  hard  for  them  to  resist  tho  impulso  to 
take  over  the  controls  before  the  student  had  n  chnnco  to  notico  and 
correct  tho  difficulty  himself.  Many  expressed  the  opinion  that  in¬ 
structing  was  more  dangerous  than  combat  and  that  they  did  not  want 
to  have  survived  combat  only  to  be  killed  on  a  training  mission. 

Interviews  disclosed  that,  for  the  married  men,  the  most  important 
source  of  satisfaction  in  tho  instructor  assignment  was  the  chanco  to 
have  a  relatively  stable  home  life  with  their  families.  For  them,  tho 
routine  had  its  compensations  in  that  they  were  able  to  plan  ahead, 
counting  on  definite  hours  with  their  families.  In  a  study  mndo  of 
the  relationship  between  biographical  factors  and  students'  and 
supervisors’  ratings  of  instructor  proficiency,  it  was  found  that 
supervisors  rated  the  instructors  who  were  married  and  whoso  wives 
were  living  with  them  as  better  than  the  unmarried  instructors. 

Many  other  of  the  returned  combat  pilots  did  not  relish  an  instruc¬ 
tor  assignment  but  preferred  it  to  return  to  combat.  Tho  singlo  men 
indicated  that  they  would,  for  the  most  part,  liavo  preferred  a  roving 
assignment,  such  ns  in  tho  Air  Transport  Command. 

In  order  to  secure  some  indication  of  the  interest  of  returned  combat 
pilots  taking  the  instrument  instructors  course  at  Bryan  in  an  instruc¬ 
tor  assignment,  students  in  class  44-9  (the  second  class  with  a  returnee 
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populatioi )  were  asked  to  indicate  their  interest  in  an  instructor 
assignment  on  a  5-point  scale.  Forty-nino  returnees,  or  56  percent 
of  tho  87  men  in  tho  class,  expressed  high  or  moderate  interest  in  this 
assignment;  24  men  or  28  percent  reported  that  they  had  no  interest 
or  were  definitely  opposed  to  such  an  assignment;  and  14  men,  or 
16  percent,  reported  they  were  indifferent  to  a  teaching  assignment. 

Summary  of  Basic  Hypotheses  about  Qualities  of  Good  Flying  Instructors 

As  a  result  of  the  preceding  studies  and  interviews,  the  following 
qualities  are  considered  to  bo  important  to  the  success  of  a  flying 
instructor.  All  of  these  factors  are  believed  to  be  significant.  No 
attempt  is  made  to  list  them  in  order  of  importance.  The  attempt 
has  been,  rather,  to  place  related  qualities  together. 

1.  Interest  in  teaching  flying.— Experienced  supervisors  and  instruc¬ 
tors  in  both  Primary  and  Advanced  schools  have  ranked  interest  in 
tho  job  of  teaching  flying  as  the  one  quality  most  important  for  a 
good  instructor.  Students  also  rate  this  quality  as  being  important 
in  an  instructor.  To  tho  extent  that  an  officer  hns  a  clear  and  correct 
idea  of  what  the  instructor  assignment  involves  and  is  not  choosing  it 
merely  to  avoid  some  other  job,  such  as  combat,  his  preference  for 
that  assignment  should  predict  his  interest  in  it.  In  order  to  check 
on  the  men  whoso  preferences  may  bo  based  on  inadequate  knowledge 
or  the  desire  to  cscapo  other  assignments,  the  preference  should  bo 
supplemented  by  other  indirect  measures  of  interest.  In  general,  tho 
men  from  certuin  backgrounds,  with  certain  patterns  of  attitudes  and 
related  interests,  arc  most  likely  to  become  and  remain  interested  in 
teaching  flying. 

2.  Desire  jor  stable  family  life. — The  basic  assumption  is  that  officers 
whoso  nttitudes,  interests,  and  circumstances  arc  such  that  they  will 
get  satisfaction  out  of  tho  type  of  life  that  instructors  lend  (a  relatively 
routino,  stnblo  one  for  tho  wartime  Air  Forces)  arc  moro  likely  io 
becomo  interested  in  teaching.  This  factor  should  o  prcdictivo  of 
adjustment  to  tho  instructor  situation  regardless  of  whether  tho 
officer  had  a  clear  idea  of  tho  instructor’s  job  or  chose  it  to  avoid  somo 
other  assignment.  Married  officers,  returned  from  combat  and  serv¬ 
ing  as  instructors,  stated  that  being  able  to  live  with  their  families  and 
plan  their  time  on  a  routine  schedule  was  one  of  their  sources  of  satis¬ 
faction  with  this  assignment. 

3.  Interest  in  people. — Many  instructors  complained  that  their  jobs 
were  monotonous,  flying  over  the  same  territory  day  after  day.  These 
men  seemed  to  go  stalo  after  ten  or  twelve  months  of  instructing. 
Other  instructors  reported  that  their  job  never  became  boring,  that 
students  were  continually  doing  new  things  each  day  and  that  no  two 
students  wore  alike.  These  instructors  reported  that  they  wero  con¬ 
tinuing  to  improve  even  after  two  or  three  years  of  instructing.  Tho 
difference  between  these  two  is  that  the  second  type  of  instructor  has 
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social  insight  mul  imagination  and  is  interested  in  people.  He  is  able 
to  alter  and  adapt  his  technique  of  teaching  to  tho  individual  needs 
of  his  student.  One  of  the  most  important  compensations  for  tho 
effort  of  teaching  is  the  satisfaction  of  seeing  tho  student  improvo. 
Those  interested  in  people  arc  more  likely  to  find  this  a  sourco  of  keen 
satisfaction.  Since  interest,  participation,  enjoyment,  and  success 
arc  all  likely  to  he  related,  having  a  history  of  participation  in  and 
enjoying  activities  involving  people,  having  previously  succeeded  as  a 
salesman,  camp  leader,  physical  director  or  teacher,  should  bo  favor¬ 
able  indications  for  success  as  a  flying  instructor. 

4.  Ability  to  understand  people  and  adapt  techniques  to  the  individual 
student. — Supervisors,  instructors,  and  students  all  ranked  adapting 
teaching  methods  to  the  individual  student  among  tho  very  important 
qualities  of  a  good  instructor.  This  quality  is  especially  important 
in  a  pilot  instructor  since  learning  to  fly  in  tho  accelerated  army 
program  was  likely  to  frighten,  confuse,  or  discourago  tho  student 
who  was  handled  improperly.  This  ability  is  related  to  interest  in 
people,  tho  quality  which  has  just  been  discussed. 

5.  Patience  and  self-control. — Students  ranked  this  ns  being  nir.ong 
tho  two  most  important  attributes  of  an  instructor.  They  mndo  tho 
point  that  it  is  very  difficult  to  learn  under  conditions  whero  tho 
student  feels  that  tho  instructor  is  critical  of  his  mistakes,  which  are 
numerous,  and  may  at  any  moment  bccomo  angry  and  "blow  up." 
Supervisors  and  instructors  ranked  this  quality  in  tho  instructor  in 
fourth  and  sixth  placo,  respectively,  in  order  of  importance.  In¬ 
structors  mentioned  that  ono  of  tho  moro  common  sources  of  nnnoy- 
nnco  in  their  job  was  having  student  after  student  repeatedly  mako  tho 
same  mistakes.  As  soon  ns  ono  group  of  students  improves,  they 
graduato  and  a  new  group  comes  in  so  tho  process  is  repeated  ad 
infinitum.  Added  to  this  is  tho  fact  that  it  is  particularly  exasperating 
to  attempt  to  teach  someone  a  motor  skill  whero  tho  instructor  can 
sec  the  mistakes  easily  but  finds  it  difficult  to  explain  boenuso  critical 
parts  of  tho  activity  are  not  verbalized  in  our  language.  An  instructor 
who  does  not  possess  a  high  degreo  of  paticnco  nnd  self-control  is  likely 
to  give  his  pupil  a  tonguo  lashing  when  ho  should  ho  rewarding  any 
slight  signs  of  improvement  which  oppenr.  This  will  often  undcr- 
mino  tho  confidence  of  tho  student. 

6.  Ability  to  express  himself. — Supervisors,  instructors,  nnd  students 
all  ranked  this  quality  ns  being  among  tho  fivo  most  important 
attributes  of  a  good  flying  instructor.  Students  stated  that  tho  lack 
of  a  detailed  explanation  before  a  maneuver  is  demonstrated  and  a 
conciso  statement  as  to  just  what  was  wrong  with  a  maneuver  wero 
two  of  their  most  frequent  criticisms  of  instruction.  In  order  to  give 
a  good  explanation,  an  instructor  1ms  to  know  his  subject  in  words  or 
diagrammatic  symbols  instead  of  just  in  terms  of  muscular  movements. 
Ho  may  not  need  excellent  grammar  and  vocabulary,  but  should  bo 
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able  to  express  himself  clenrly.  The  problem  of  expression  is  made 
more  difficult  by  the  fact  that  so  much  of  tho  skill  is  unverbalized. 

7.  Ability  to  analyze  errors. — An  instructor  must  be  able  to  analyze 
a  student's  errors  in  order  to  tell  him  what  he  is  doing  wrong.  Super¬ 
visors  and  instructors  ranked  this  respectively  as  tho  second  and  third 
most  important  quality  of  a  good  instructor.  Students  ranked  it 
somewhat  lower  but  placed  it  well  within  tho  10  most  important 
qualities.  A  good  pilot  may  not  be  able  to  tell  the  student  specifically 
what  ho  docs  incorrectly.  It  is  necessary  for  the  instructor  to  have 
his  subject  mutter  conceptualized  in  either  verbal  or  visual  symbols. 
Ability  to  do  this  is  probably  related  to  mechanical  comprehension 
and  knowledge  of  principles  of  Hying. 

8.  Ability  as  a  pilot. — The  instructor  must  be  a  mister  of  the  art 
which  he  is  trying  to  teach.  He  must  not  only  be  ablo  to  demonstrate 
tho  correct  maneuver  but  also  to  mimic  and  exaggerate  any  typo  of 
error  which  tho  student  may  make.  Supervisors  placed  flying  ability 
sixth,  instructors  placed  it  fifth,  and  students  rated  it  fourth  in  their 
list  of  the  most  important  qualities  of  the  good  flying  instructor. 

9.  Self-confidence— Not  ajraid  of  plane  or  student. — Tho  instructor 
who  is  somewhat  anxious  is  likely  to  take  over  the  controls  to  relievo 
his  own  nervousness  at  times  when  he  should  allow  the  student  to  get 
practice  in  recognizing  and  correcting  his  own  mistakes.  Not  riding 
controls  was  the  quality  selected  by  Advanced  and  Transition  school 
students  as  being  tho  second  most  important  attribute  of  a  good  in¬ 
structor.  Furthermore,  the  instructor  who  is  afraid  either  of  the  plane 
or  the  student  is  not  likely  to  inspire  confidence  in  his  pupil.  This 
is  especially  important  in  selecting  instructors  from  tho  combat  re¬ 
turnee  population,  since  many  of  them  still  suffer  from  a  generalized 
anxiety  as  a  result  of  thei**  combat  experience. 

10.  Conscientious  habits  of  trying  to  do  a  good  job. — Some  instructors, 
who  have  no  particular  interest  in  this  assignment,  try  hard  and  suc¬ 
ceed  because  they  have  formed  the  habit  of  doing  the  best  work  possi¬ 
ble  on  any  job  that  is  assigned  to  them.  Good  work  habits  will  help 
the  instructor  to  cope  with  the  more  tiresome  aspects  of  his  job.  To 
a  certain  extent  conscientious  work  habits  may  be  predicted  from  an 
individual’s  home  background  and  other  biographical  facts..  Con¬ 
scientiousness  may  also  be  predicted  from  his  behavior  during  cadet 
training  and  his  attitudo  toward  duty,  discipline,  and  the  army  in 
general.  Experience  in  the  bombardier  and  navigator  schools  indi¬ 
cates  that  this  type  of  factor  is  especially  important  with  combat 
returnees. 

11.  A  gooil  example  of  offictr  qualities. — The  instructor  should  be  a 
good  officer  so  that  his  students  will  respect  him.  His  behavior  on 
the  ground  and  in  the  air  should  in  all  respects  set  a  good  example  for 
the  student,  for  his  students  will  not  only  copy  his  flying  but  will  also 
tend  to  pattern  themselves  after  everything  that  he  does.  This  is 
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especially  true  of  Primary  students  who  are  just  beginning  their 
flying  training. 

STUDIES  OF  EXISTING  METHODS  OF  INSTRUCTOR 

SELECTION 

As  another  step  in  the  research  on  flying  instructors,  studies  wero 
made  of  existing  methods  of  instructor  selection.  These  studies  in¬ 
cluded  investigations  of  the  basis  on  which  students  are  graduated 
from  the  AAF  Central  Instructors  School  at  Randolph  Field,  of  tho 
factors  which  predict  success  at  Central  Instructors  School,  and  of  tho 
way  in  which  students  are  selected  to  be  sent  to  that  school.  Tho 
task  of  the  Central  Instructors  School  was  to  train  instructors  for 
teaching  contact  flying  in  Basic  and  Advanced  schools. 

Basis  for  Graduation  from  Centra!  Instructors  School  ** 

First  a  study  was  made  of  the  basis  for  graduating  or  eliminating 
students  from  Central  Instructors  School.  Interviews  with  super¬ 
visory  personnel  established  the  fact  that  with  the  relatively  short 
period  of  time  allotted  for  turning  out  large  numbers  of  instructors, 
the  main  effort  of  the  school  was  concentrated  upon  bringing  them  up 
to  a  satisfactory  level  of  flying  proficiency.  They  indicated  that  tho 
graduation  or  elimination  of  a  student-instructor  was  determined 
almost  entirely  by  his  ability  to  absorb  tho  intensivo  course  of  flying 
instruction.  In  order  to  verify  the  actual  operation  of  this  policy  at 
the  Central  Instructors  School,  a  study  was  •*  .ulc  of  the  relationship 
of  flying  grades  and  of  academic  ratings  to  graduation  or  elimination. 
This  study  involved  340  students  in  class  43-8.  In  each  of  tho  threo 
groups  nt  Central  Instructors  School  (Basic,  Advanced  single-cngino 
and  Advanced  two-engine),  it  was  found  that  all  of  tho  graduates 
received  a  flying  grade  of  D  or  better  and  all  of  the  eliminees  received 
a  flying  grade  of  F.  No  students  received  a  grade  of  E.  Tho  fact 
that  there  was  a  perfect  dichotomy  between  the  graduates  and  elim¬ 
inees  on  the  basis  of  flying  grades  suggested  that  no  other  factors  wero 
involved  in  elimination  and  thus  confirmed  *hc  results  of  interviews. 

In  order  to  confirm  further  this  impression,  the  academic  ratings  of 
graduates  and  eliminees  were  compared.  The  academic  rating  was 
based  on  a  student’s  proficiency  in  all  ground  school  courses  which 
included  Analysis  of  Maneuvers  and  Psychology  of  Instruction. 
When  this  was  done,  it  was  found  that  there  were  no  reliable  differ¬ 
ences  between  the  academic  ratings  of  graduates  and  eliminees  for 
students  in  the  Basic  (Ar=150)  or  in  tho  Advanced  single-cngino 
(.V=79)  groups.  In  tho  advanced  two-engine  group  (iV=117),  tho 
graduates  received  a  significantly  higher  academic  rating  than  tho 
eliminees  ( C .  Ii= 3.2).  The  fact  that  there  was  on  the  whole  so  littlo 
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djfTcrcnco  between  the  academic  ratings  of  graduates  and  climinccs 
further  confirmed  tho  impression  that  students  aro  graduated  from 
this  school  on  the  basis  of  only  ono  of  tho  qualities  necessary  to  the 
good  flying  instructor,  namely,  flying  ability. 

Prediction  of  Success  at  Central  Instructors  School  •* 

After  it  was  found  that  graduation  from  CIS  (i.  e.,  Central  Instruc¬ 
tors  School)  was  determined  solely  by  flying  ability,  an  attempt  was 
mado  to  ascertain  how  well  measures  of  flying  proficiency  available 
at  tho  schools  whero  tho  student-instructors  aro  selected  would  pre¬ 
dict  th  student’s  subsequent  success  at  CIS.  Tho  Proficiency  Card, 
AFTRC  Form  No.  2,  was  the  record  used  to  sccuro  data  on  the  flying 
proficiency  of  tho  students  during  their  cadot  training.  It  is  a  record 
which  at  that  time  followed  tho  cadet  through  training  and  which 
contained  estimates  of  his  general  pilot  ability,  ability  on  various 
aspects  of  flying,  and  on  personal  qualities  at  each  stage  of  his  training. 

The  proficiency  card  data  showed  that  there  was  a  low  but  positive 
relationship  between  ratings  on  tho  Proficiency  Card  at  basic  and 
advanced  schools  and  elimination  for  flying  deficiency  at  Central 
Instructors  School.  As  would  bo  expected,  the  ratings  on  flying 
ability  were  somewhat  moro  predictive  than  tho  ratings  on  general 
personal  qualities.  Somo  of  tho  specific  flying  ratings  (such  as  the 
ono  on  formation  flying)  were  at  least  as  predictive  of  success  at  CIS 
as  tho  rating  on  General  Pilot  Ability.  Combined  scores,  consisting 
of  a  simple  sum  of  ratings  on  spins  and  stalls,  acrobatics,  and  formation 
flying  in  basic  school;  judgment  and  common  senso,  night  flying,  and 
formation  flying  in  advanced  school,  correlated  0.40  with  graduation- 
elimination  at  Central  Instructors  School,  wliilo  ratings  on  General 
Pilot  Ability  at  advanced  school  correlated  only  0.23.  This  study 
was  based  on  the  proficiency  records  of  74G  Central  Instructors  School 
students  in  Classes  44-B,  44-C,  and  44-D,  Randolph  Field,  Tex. 

Type  of  Student  Sent  to  Central  Instructors  School  •* 

Sinco  tho  record  of  a  student’s  flying  proficiency  in  basic  and  ad¬ 
vanced  school  was  somewhat  prcdictivo  of  his  success  at  Central 
Instructors  School,  a  study  was  mado  to  see  if  tho  students  with 
better  records  tvcrc  recommended  and  sent  to  this  school  for  instructor 
training.  Using  a  population  of  2,523  students  in  Class  44-B, 
Eastern  Flying  Training  Command,  it  was  found  that  tho  pilots 
recommended  for  tho  instructors  course  at  Central  Instructors  School 
wero  better  on  tho  basis  of  their  proficiency  card  ratings  than  those 
not  so  recommended.  It  was  further  found  that  tho  recommendations 

"  Work  on  thU  study  wu  accomplished  by  Capt.  S.  C.  Erickson,  Pgt.  John  R.  Rohrs,  and  Lt  Thomas 
N.  Ewing. 

*  Work  on  this  study  was  under  the  supervision  of  Capt.  8.  C.  Erickson.  Lt/Thomas  N.  Ewing  assisted 
In  the  study  and  Is  resiouslble  for  statist  leal  analysis  of  tba  data. 
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for  instructor  assignment  were  followed  quito  well  in  assigning  men 
to  the  CIS  advanced  single-engine  and  two-engine  groups,  but  wero 
not  followed  ns  well  in  assigning  men  to  the  CIS  basic  group.  As  a 
result,  the  students  assigned  to  the  advanced  single-cngino  and  two- 
engine  groups  at  CIS  were  better  than  tho  rest  of  their  class  in  ratings 
on  general  pilot  ability,  leadership,  and  the  other  flying  and  nonfiying 
traits  on  the  proficiency  card,  but  those  sent  to  tho  basic  group  were 
below  the  average  of  their  class.  This  difference  in  the  students  which 
advanced  schools  sent  to  the  Advanced  and  the  basic  groups  at  CIS 
may  be  explained  by  the  fact  that  tho  students  which  were  sent  to  tho 
advanced  groups  were  likely  to  como  back  to  the  samo  school  ns 
advanced  instructors,  while  those  sent  to  the  basic  group  would  not 
come  back  to  that  school.  Therefore  the  advanced  schools  were 
motivated  to  send  their  best  students  for  training  as  advanced  school 
instructors  but  were  not  so  motivated  with  respect  to  tho  students 
sent  for  training  as  Basic  instructors. 

To  summarize,  the  current  system  of  graduating  (or  eliminating) 
students  in  the  Pilot  Central  Instructors  School  was  found  to  bo 
based  almost  entirely  on  flying  proficiency;  flying  proficiency  in 
earlier  stages  of  training  was  somewhat  predictive  of  successful  com¬ 
pletion  of  the  training  at  Central  Instructors  School,  and  tho  men 
sent  for  instructor  training  in  tho  advanced  single-engino  and  two- 
engine  groups  were  superior  in  flying  proficiency  to  those  not  sent, 
while  tho  men  sent  for  training  in  tho  basic  group  were  somewhat 
inferior  becauso  recommendations  for  assignments  wero  not  at  all 
closely  followed.  Tho  existing  method  of  instructor  selection  thus 
took  into  account  ono  of  tho  qualities  of  a  good  instructor  and,  in 
general,  channeled  men  into  instructor  training  who  wero  somewhat 
above  average  in  this  quality.  It  did  not  take  much  account  of  tho 
many  other  qualities  which  arc  equally  important  in  tho  good  flying 
instructor. 

Student  Preferences  •* 

Job  analysis  studies  already  described  indicated  that  “interest  in 
the  job  of  teaching  flying”  was  ono  of  tho  most  important  qualities 
of  a  good  instructor.  Studies  were  therefore  mado  of  tho  attitudo 
of  students  in  advanced  schools  toward  assignment  ns  instructor. 
Theso  studies  were  aimed  at  discovering  whether  enough  studenta 
preferred  tho  instructor  assignment  so  that  tho  selection  of  instruc¬ 
tors  could  bo  mado  from  among  thoso  who  either  wanted  such  an 
assignment  or  at  least  had  no  strenuous  objections  to  it.  Data  on 
the  attitudo  of  tho  students  wero  also  relevant  in  deciding  whether 
or  not  an  attempt  should  bo  mado  to  disguiso  instructor  selection 

x  These  studies  were  under  the  supervision  of  Cept.  8.  C.  Erieksen.  Lie.  Thorns*  N.  Swing.  1*0  A. 
nellraer  sod  S/Sgt.  Irving  Robbins  sullied  him. 


708822— 4T - 21 


301 


I 


tests  so  that  the  students  taking  them  would  not  be  aware  of  their 
purpose.  Tho  results  of  these  studies  were  as  follows: 

A  substantial  number  of  advanced  school  students  in  Classes  44-B 
and  44-C  at  Luke  Field,  Arizona  (36  percent  of  tho  886  students 
canvassed)  expressed  a  preference  for  assignment  as  an  instructor 
(first,  second,  or  third  choice  out  of  6  possible  assignments).  Students 
who  had  a  preference  for  an  instructor  assignment  were  rated  to  bo 
as  good  a  group  of  flyers  ns  thoso  who  had  no  preference  for  instructing. 

In  another  study  of  1,046  upper  class  students  in  threo  advanced 
schools  (Class  44-E  at  Luke,  Williams,  and  Douglas  Fields),  the 
instructor  assignment  was  in  fourth  position  out  of  11  possible  choices. 
Approximately  24  percent  of  the  students  indicated  that  they  would 
be  “highly  satisfied”  with  an  assignment  as  instructor.  Tho  cadets 
were  asked  to  rate  their  own  ability  for  each  of  tho  11  listed  assign¬ 
ments  on  which  they  were  asked  to  indiente  their  preference.  The 
results  showed  a  rather  high  relationship  between  self-ratings  of 
ability  and  preference. 

Final  results  of  this  survey  indicated  that  current  quotas  for  in¬ 
structor  training  at  tho  AAF  Central  Instructors  School  (Pilot)  could 
probably  be  met  by  selecting  only  thoso  students  who  had  some 
preference  for  this  typo  of  work  and  who,  at  tho  same  time,  met  the 
other  criteria  for  instructor  selection. 

i 

SURVEY  OF  POSSIBLE  CRITERIA  FOR  VALID/VTION  OF 

INSTRUCTOR  SELECTION  TESTS  , 

* 

Need  for  a  Criterion 

In  order  to  refine  and  evaluate  tho  instructor  selection  tests,  it  was 
necessary  to  have  some  criterion  of  how  well  tho  pilots  who  took  tho 
tests  succeeded  as  teachers.  Tho  tests,  or  the  individual  items  in 
these  tests,  that  were  found  to  predict  success  would  then  bo  kept 
ami  those  which  did  not  predict  success  would  bo  discarded.  Since 
there  was  no  ready-made  criterion  of  instructor  proficiency,  it  was 
necessary  to  try  to  discover  somo  good  way  of  finding  out  how  well 
potential  flying  instructors,  who  had  been  tested,  eventually  succeeded 
ns  teachers.  The  following  subsections  deal  with  studies  of  possible 
criteria  for  validating  pilot  instructor  selection  tests. 

Judging  Instructors  by  the  Students  They  Produce 

Tho  ultimate  measuro  of  tho  success  of  a  teacher  is  tho  quality  of 
the  students  which  ho  produces.  An  investigation  undertaken  at 
Psychological  Research  Unit  No.  2  by  Copts.  Richard  P.  Youtz  and 
John  T.  Dailey  showed  that  .n  Army  flying  schools  it  w’as  impracticable 
to  uso  thh  measure  as  a  criterion  of  teaching  success  for  tho  following 
reasons:  (1)  Tho  number  of  students  assigned  to  each  instructor  was 
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so  small  that  it  would  have  taken  an  unduly  long  timo  to  build  up 
statistically  reliable  groups;  (2)  in  many  schools,  records  on  tho 
assignment  of  students  to  instructors  wero  available  for  tho  imme¬ 
diately  preceding  class  but  were  incomplete  for  all  preceding  classes; 
(3)  different  administrative  policies  produced  variations  in  tho 
elimination  rate  from  command  to  command,  from  school  to  school 
in  each  command,  and  from  class  to  class  within  each  school;  (4) 
students  were  burly  often  shifted  from  one  instructor  to  another 
during  any  given  phase  of  their  pilot  training.  Weak  students  wero 
likely  to  be  shifted  to  those  instructors  who  were  believed  to  bo  tho 
best.  While  this  is  a  sound  procedure  from  tho  point  of  view  of 
training,  it  introduced  serious  distortions  into  tho  sampling.11 

Since  evaluating  instructors  by  tho  quality  of  students  which  thoy 
produced  seemed  impractical,  investigations  wero  mado  of  tho  feasi¬ 
bility  of  obtaining  other  types  of  criterion  data. 

Investigation  of  Data  Available  at  Contact  and  Instrument  Instructors 
Schools** 

Since  it  was  the  policy  of  tho  Air  Forces  to  send  a  considerable  num¬ 
ber  of  returned  combat  pilots  to  tho  various  instructor  schools  from 
redistribution  stations,  personnel  from  the  Pilot  Project  mndesurvoys 
of  the  various  types  of  instructors  schools  in  order  to  determino  what 
data  were  available  against  which  a  battery  of  instructor  selection  tests 
being  administered  to  these  returnees  might  bo  validated.  Tho  in¬ 
structor  schools  investigated  were:  AAF  Central  Instructors  School, 
Randolph  Field,  Tex.;  Instructors  School  (Pilot  4-Engino,  B-24), 
Smyrna  Army  Air  Field,  Smyrna,  Term.;  Instructors  School  (Pilot 
4-Knginc,  B-17),  Lockbourno  Army  Air  Base,  Columbus,  Ohio;  and 
AAF  Inslrut  ors  School  (Instrument  Pilot),  Bryan,  Tex.  Tho  con¬ 
clusions  with  regard  to  tho  criterion  data  avuilublo  at  theso  schools 
arc  presented  below. 

No  practico  teaching  of  students  by  student-instructors  nor  any 
systematic  program  of  simulated  practico  teaching  of  instructors  by 
student-instructors  was  being  carried  out  in  nny  of  tho  various  CIS 
groups  nt  Randolph  Field,  Smyrna,  or  Lockbourno.  No  soparato 
grades  wero  given  of  tho  instructing  ability  of  tho  students  independent 
of  flying  proficiency.  Interviews  with  supervisory  personnel  indicated 
that  it  was  necessary  to  use  all  tho  available  timo  at  theso  Central  In¬ 
structors  Schools  to  bring  students  up  to  tho  necessary  level  of  flying 
proficiency  and  that  no  emphasis  could  bo  pluccd  on  teaching  students 
to  instruct  in  tho  air.  AH  measures  investigated  at  theso  schools 
wero  evaluations  of  tho  flying  ability  of  tho  students  rather  than 

*•  The  Navy  Also  found  thot  they  mill  )  not  use  the  fmrtuatlon-ellnilnUlon  rat*  of  an  Instructor'*  student* 
as  an  inde*  of  the  Instructor’s  proflcln  for  similar  reasons. 

*  The  surveys  at  the  Instructor*  Schools  were  under  the  supervision  ofl.t.  William  E.Oalt.  I.l.Thoma* 
N.  Ewln*,  T/S*t.  Robert  R.  Blake.  P/S*t.  Irvin*  Robbins  and  S/S*t.  Walter  Ismael  misled  In  the  surrey*. 
Th*  statistical  work  lurolred  wm  doo*  by  FjC  John  R.  Rohr*. 
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measures  of  their  proficiency  as  instructors.  Thoy  would,  therefore 
bo  valid  criteria  for  only  this  ono  of  the  many  qualities  important  in 
tho  good  flying  instructor. 

Threo  record  forms  were  found  availablo  at  the  AAF  Instructors 
School  (Instrument  Pilot),  Bryan,  Tex.,  which  recorded  in  some 
mcasuro  a  student's  ability  as  an  instructor.  These  wero:  (1)  Recom¬ 
mendation  for  Association  with  the  Instrument  Instructor  Program; 
(2)  pass-fail;  and  (3)  scores  on  an  Instructor  Cheek  Ride.  Tho  first 
two  were  not  suitablo  for  uso  as  criteria  since  tho  percentage  of  stu¬ 
dents  not  recommended  and  tho  percentage  failing  the  course  was 
relatively  small. 

In  general,  tho  desired  criterion  within  the  instructors  schools  is  a 
measuro  of  tho  instructional  ability  of  tho  student  in  a  practice- 
teaching  situation.  The  instructor  check  ride  was  tho  only  situation 
which  gavo  any  promise  of  fulfilling  this  condition,  although  it  had 
tho  disadvantage  of  not  being  a  natural  teaching  situation.  In  this 
check  ride,  which  was  administered  once  to  each  class  of  students,  the 
student-instructor  was  required  to  simulate  teaching  the  staff-instruc¬ 
tor  somo  previously  assigned  lesson.  Tho  student  was  graded  on  his 
voice,  his  demonstration  technique,  his  explanation  technique,  and  his 
analysis  of  maneuvers.  Ho  was  graded  as  “Excellent,”  “Satisfactory,” 
or  “Unsatisfactory.”  An  examination  of  tho  ratings  of  the  first  class 
of  returned  combat  pilots  showed  a  poor  distribution  of  grades  into 
tho  categories  of  “Excellent,”  “Satisfactory,”  and  “Unsatisfactory,” 
sinco  too  largo  a  percentage  (approximately  80  percent)  fell  into  the 
middlo  or  “Satisfactory”  group. 

Sinco  it  was  necessary  to  improvo  tho  distribution  of  instructor 
check-ride  scores  if  tho  check-rides  were  to  bo  used  as  criterion  data 
for  validating  instructor  selection  tests,  a  four-point  scale  of  scoring 
was  suggested  to  supervisory  personnel.  This  was  adopted.  It  had 
tho  effect  of  splitting  the  largo  “Satisfactory”  group  into  two  groups. 
It  was  also  desired  to  cnlargo  tho  number  of  qualities  rated  on  the 
check  ride,  to  make  them  moro  objective  and  to  apply  a  differential 
weighting  to  tho  various  qualities.  Such  a  revised  check-ride  card 
wms  drawn  up  by  personnel  from  tho  Pilot  Project  in  collaboration 
w’ith  picked  Bryan  instructors,  but  from  an  administrative  standpoint 
it  was  not  feasible  to  adopt  many  of  tho  revisions  recommended. 

In  order  to  evaluate  further  tho  adequacy  of  tho  Instructor  Cheek 
Rido  os  a  criterion  against  which  to  validato  tho  instructor  selection 
tests,  studies  were  made  to  determine  (1)  tho  reliability  of  tho  check 
ride,  (2)  tho  intercorrclations  of  its  various  categories,  and  (3)  the 
extent  to  which  scores  on  tho  various  categories  of  tho  check  ride 
were  influenced  by  previous  experience  as  an  instructor  and  by  instru¬ 
ment  flying  proficiency. 

Tho  number  and  typo  of  Bryan  student-instructors  involved  in 
theso  threo  studies  wero  as  follows:  179  combat  returnees  and  non- 


304 


returnees  in  class  44-9  in  studies  (1)  and  (2);  307  nonrcturnccs  in 
classes  44-6,  44-7,  and  44-9,  and  374  nonreturncos  in  classes  44-6  and 
44-7  in  study  (3).  The  results  of  these  studies  are  presented  in  tabular 
form  in  table  14.3. 

The  reliability  cocflicicnts  for  the  categories  of  the  Instructor  Cheek 
Ride  when  the  retest  was  given  by  another  check  rider  7  to  10  days 
after  the  initial  ride  ranged  from  0.25  for  Voice,  to  0.54  for  Explanation 
Ttchnique.  The  over-all  reliability  (sum  of  the  categories)  was  0.48; 
that  of  the  sum  of  all  categories  except  Voice,  was  0.52. 

The  intcrcorrclations  between  the  various  categories  of  the  check 
ride  ranged  from  0.G2  to  0.90.  In  general,  Voice  showed  the  lowest 
intcrcorrclations  with  the  other  items.  The  generally  high  intcrcor- 
relations  indicated  a  rather  high  relationship  among  the  various  cate¬ 
gories  with  the  exception  of  Voice.  Voice  probably  correlated  less 
highly  with  the  other  categories,  because  it  was  tho  least  reliable. 
The  high  intcrcorrclations  may  have  resulted  in  part  from  tho  fact 
that  the  various  categories  of  the  check  ride  meosured  similar  things. 
The  fact,  however,  that  all  of  the  intcrcorrclations  were  higher  than 
the  reliabilities  of  the  individual  items  indicated  that  a  considerable 
degree  of  “halo”  effect  was  also  present. 


Tam.k  14.3. — Reliability,  intcrcorrclations,  and  rrlationthip  of  categories  of  the 
instrument  instructor  check  ride  to  instructor  experience  ana  instrument  flying 
proficiency 
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Previous  experience  as  an  instructor  was  found  to  improve  instruc¬ 
tor  proficiency  as  measured  by  tho  ratings  on  the  Instructor  Check 
Ride  Correlations  were  relatively  low  but  all  positive.  They  ranged 
from  0.19  for  Voice  to  0.30  for  Knowledge  oj  Subject. 

In  determining  the  relationship  between  scores  on  the  Instructor 
Check  Ride  and  instrument  flying  proficiency,  the  Basic  Proficiency 
Check  Ride  was  used  as  a  measure  of  n  .trumcnt  flying  skill.  An 
unweighted  combination  of  the  different  scores  on  this  cheek  ride  of 
instrument  flying  proficiency  was  correlated  with  tho  unweighted 
combination  of  scores  on  the  Instructor  Cheek  Ride.  It  was  found 
that  the  combined  scoro  on  tho  Instructor  Cheek  Ride  was  relatively 
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independent  of  instrument  flying  skill  as  measured  by  the  Bnsit 
Proficiency  Cheek  Ride.  The  correlation  between  these  two  chock 
rides  was  0.13  with  a  S.  E.  of  0.05.  This  showed  that  the  Instructor 
Cheek  Rido  does  not  merely  duplicato  other  measures  of  flying 
proficiency. 

The  results  of  the  above  studies  indicated  that  the  Bryan  Instructor 
Cheek  Ride  is  a  possible  criterion  for  the  validation  of  the  instructor 
selection  tests.  The  fact  that  scores  on  the  Instructor  Cheek  Ride 
were  relatively  independent  of  the  rating  on  instrument  flying  ability 
and  wero  somewhat  related  to  previous  experience  as  an  instructor 
suggests  that  this  was  a  desirable  criterion  of  performance  os  a  teacher. 
A  disadvantage  of  the  Instructor  Cheek  Ride  as  a  measure  of  teaching 
proficiency  was  that  the  teaching  situation  involved  was  a  simulated 
one  (student-instructor  teaching  a  staff  instructor)  rather  than  a  real 
ono  (student-instructor  teaching  a  student).  Thcro  was  the  further 
disadvantage  that  it  would  not  be  possible  to  validate  the  instructor 
selection  tests  on  the  population  of  returned  combat  pilots  flowing 
through  the  AAF  Instructors  School  (Instrument  Pilot)  at  Bryan, 
Tex.  This  was  due  to  the  fact  that  the  number  of  returned  combat 
pilots  taking  this  course,  on  whom  scores  on  the  battery  of  tests  ad¬ 
ministered  at  Redistribution  Stations  were  also  available,  was  found 
to  bo  small. 

Early  Work  on  Ratings  of  Instructors  by  Their  Students 

Sinco  tho  prospects  of  securing  data  at  instructors  schools  against 
which  to  validato  tho  pilot  instructor  selection  tests  wero  not  en¬ 
couraging,  the  development  of  some  form  of  measurement  of  the  in¬ 
dividual  instructor’s  teaching  ability  in  tho  real  teaching  situation 
at  tho  flying  schools  beenmo  important.  A  man’s  teaching  ability 
after  he  is  actually  functioning  in  an  instructor  assignment,  his  on-the- 
job  performance,  should  bo  a  moro  valid  criterion  of  his  instructor 
proficiency  than  his  manner  of  performance  whilo  receiving  training 
at  an  instructors  school.  The  administrative  and  statistical  difficulties 
of  judging  instructors  by  the  students  they  produce  have  already  been 
discussed  in  this  chapter.  It  became  apparent  that  perhaps  tho  only 
practical  method  of  securing  an  evaluation  of  tho  flying  instructor’s 
teaching  ability  was  through  somo  typo  of  rating  scale. 

Prior  to  the  establishment  of  tho  Psychological  Research  Project 
(Pilot),  Lt.  Col.  R.  T.  Sollcnbergcr,  from  the  Psychological  Section, 
Headquarters  AAF  Training  Coinmnnd,  had  students  at  a  priraaiy 
school  rato  their  instructors.  IIo  used  a  scnlo  adapted  from  ono 
which  Lt.  Commander  Lowell  Kelly  developed  and  used  in  tho  Navy’s 
flying  training  program.”  Lt.  Col.  Sollcnbergcr  found  that  the 
primary  students  had  a  strong  tendency  to  rato  all  of  their  instructors 
at  tho  favorablo  extreme  of  tho  scale  and  concluded  that  tho  distri- 

•  D.  8.  N»»y.  A  DtarnosUc  S<»!«  for  lUtlog  night  lutrocton.  N.  A.  P.  T.  C.  Form  No.  HI, 
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bution  of  responses  was  not  adequate  to  justify  further  work  at  that 
level  of  training. 

Members  of  the  Pilot  Project  judged  that  better  responses  might 
be  secured  from  students  who  knew  moro  about  flying  and  had  had 
experience  with  a  number  of  different  instructors.  Therefore,  tho 
nine  items  in  the  scale  which  could  be  adapted  for  use  in  advanced 
schools  were  administered  to  1,04G  students  in  class  44-E  at  Luke, 
Williams,  and  Douglas  Advanced  Flying  Schools.  A  statistical  anal¬ 
ysis  of  the  data  showed  the  distribution  of  instructor  ratings  on  tho 
nine-item  scale  provided  a  fairly  adequate  spread  from  low  to  high 
ratings.  This  distribution  was  considerably  better  than  that  secured 
by  Lt.  Col.  Sollcnberger  at  tho  Primary  school  level,  where  tho 
majority  of  instructors  was  rated  at  the  favorable  extremo  on  most 
items. 

Tho  reliability  of  the  Advanced  school  students'  ratings  of  their 
instructors  was  also  satisfactorily  high.  When  the  average  of  ratings 
by  four  of  each  instructor’s  students  was  compared  with  the  averago 
of  another  randomly  selected  four,  tho  correlation  was  0.78.  In 
interpreting  this  correlation,  two  facts  should  bo  kept  in  mind:  each 
instructor  was  rated  by  different  students,  in  contrast  with  tho  ordi¬ 
nary  stituation  in  which  all  individuals  are  rated  by  tho  same  pair  of 
judges.  There  may  bo  some  tendency  for  tho  different  students 
assigned  to  tho  same  instructor  in  tho  samo  class  to  influence  each 
other’s  opinions. 

The  relatively  few  favorable  ratings  by  the  Avanccd-scliool  students 
should  not  bo  taken  to  indicate  inferior  instruction  at  this  level.  It 
is  more  likely  that  the  diffcrenco  was  related  to  tho  fact  that  tho 
advanced  students  knew  much  more  about  flying  and,  hence,  wero 
not  so  inferior  to  their  instructors  in  this  respect;  also,  they  had  had 
experience  with  more  instructors  and,  hence,  had  a  better  standard  of 
comparison  against  which  to  evaluato  their  instructors.  This  inter¬ 
pretation  was  corroborated  by  a  later  study  in  which  a  longer  students' 
rating  scale  of  flying  instructors  was  administered  to  students  in  tho 
Transition  school  at  Fort  Worth  Army  Air  Field.  It  was  found  that 
tho  students  with  instructor  experience  tended  to  rate  their  instructors 
somewhat  lower  than  did  tho  men  who  had  not  been  instructors. 

This  study  indicated  tho  desirability  of  a  moro  conipleto  analysis 
of  instructor  ratings  by  students  ns  ono  of  several  potential  criteria  to 
be  used  in  instructor  selection  and  for  tho  validation  of  tho  instructor 
selection  tests. 

Exploratory  Work  on  Supervisor’s,  Student’s,  and  Self-Ratings  of 
Instructors 

Scale  Jor  rating  oj  civilian  instructors  in  primary  schools  by  their 
supervisors .** — As  ono  means  of  validating  a  battery  of  instructor 

M  Cept.  John  T.  Dfciley  tu  tb«  chief  contributor  In  tho  development  of  thli  ictU. 
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selection  tests  developed  at  that  unit,  personnel  of  Psychological  Re¬ 
search  Unit  No.  2  constructed  a  descriptive  rating  scale  on  which 
supervisors  rated  their  instructors.  The  items  included  were  tho  14 
items  of  a  22-item  checklist  of  characteristics  considered  by  supervisors 
to  he  most  important  in  the  flying  instructor.  The  items  of  the  check¬ 
list  were  selected  after  interviews  with  supervisors  at  three  primary 
schools;  it  covered  tho  points  judged  by  supervisors  to  bo  important 
characteristics  of  the  good  flying  instructor.  Two  over-all  items  were 
also  included  in  tho  rating  scale.  This  descriptive  rating  scale  was 
administered  at  five  primary  schools.  Each  instructor  was  rated  by 
two  civilian  supervisors  who  were  in  charge  of  flights  of  instructors, 
usually  the  flight  supervisor  and  assistant  flight  supervisor. 

An  analysis  of  the  results  of  tho  administration  of  the  scalo  showed 
that,  for  the  most  part,  tho  percent  of  tho  instructors  assigned  each 
descriptive  choice  on  each  item  was  fairly  stablo  from  school  to  school. 
Tho  entire  range  of  choices  on  each  item  was  used  by  tho  raters  and,  in 
general,  tho  distributions  of  responses  were  fairly  symmetrical.  The 
agreement  among  the  distributions  of  the  various  schools  was  taken  as 
cvidcnco  that  tho  dcscriptivo  statements  tended  to  havo  consistent 
meanings  from  school  to  school.  It  was  possible  to  obtain  ratings  by 
two  different  supervisors  of  198  of  the  instructors  at  5  of  the  schools. 
Tho  correlation  between  total  scores  on  tho  rating  scalo  for  two  raters 
was  0.05  thus  indicating  that  tho  scalo  had  fairly  high  reliability.  The 
degree  of  independence  of  tho  two  ratings  of  an  instructor  is  not  known. 
Although  tho  ratings  wero  mado  independently,  tho  supervisors  had 
undoubtedly  previously  discussed  their  instructors'  proficiency,  and 
tho  correlation  between  tho  two  ratings  possibly  was  raised  by  this 
pooling  of  information. 

The  intorcorrclations  of  tho  items  of  tho  rating  scalo  ranged  from 
0.2G  to  0.90  with  the  majority  of  them  relatively  high.  This  indicated 
tho  presence  of  a  “lmlo”  effect  in  tho  ratings  ns  well  as  a  possibly 
closo  relationship  among  tho  factors  measured  by  tho  items. 

Early  forms  of  rating  scales  for  evaluating  basic,  advanced,  and 
transition  military  flying  instructors. — Tho  first  step  in  exploring  tho 
possibilities  of  using  rating  scales  to  sccuro  criterion  data  on  military 
flying  instructors  was  taken  by  Psychological  Research  Project  (Pilot) 
and  consisted  in  comparing  ratings  by  tho  instructor's  supervisor,  his 
students,  and  by  tho  instructor  himself.  It  was  thought  that  each  of 
theso  types  of  ratings  might  havo  its  own  advantages  in  dealing  with 
certain  areas  of  tho  instructor’s  proficiency  and  adjustment  to  his  job. 

On  tho  basis  of  tho  examples  of  good  and  bad  teaching  techniques, 
tho  checklists  of  qualities  most  desirable  in  an  instructor,  and  other 
materials  described  in  tho  job  analysis  section  of  this  chapter,  Sgt. 
Daniel  J.  Grier  and  Lt.  Wallaco  Nygard  constructed  two  47-item 
rating  scales.  One  of  theso  was  for  students  to  rato  their  instructors; 
tho  other  for  instructors  to  rato  themselves.  Though  tho  specific 
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form  of  statement  in  each  scale  was  adapted  to  its  use,  tho  subject 
material  and  alternatives  were  parallel.  A  shorter  scale  of  1C  items 
was  constructed  for  the  supervisors.  In  constructing  this  scale,  an 
attempt  was  made  to  select  the  1G  items  which  wero  most  important 
and  on  which  the  supervisors  would  he  most  likely  to  ho  able  to  givo 
relevant  ratings.  Tho  statement  of  the  item  was  in  most  eases  iden¬ 
tical  with  that  used  in  the  student’s  scale. 

The  three  scales  were  administered  to  student  officers  taking  transi¬ 
tion  training  at  Fort  Worth  Army  Air  Field.  A  total  of  74  supervi¬ 
sors’  ratings,  72  self-ratings,  and  230  students’  ratings  was  secured. 
Results  on  a  sample  item  aro  presented  below. 


Distribution  ol  responses 

Item 

Students 

Supervisors 

■  Self 

Aidlity  to  etpress  himself 

Ptrttnl 

U 

Si 

to 

00 

Ptrcrnt 

28 

62 

10 

Ol 

Pcrant 

19 

03 

13 

03 

This  Instructor  has: 

4  An  excellent  command  of  language  and  never  has  difficulty  la 
iimMnt:  things  clear. 

3.  A  good  command  of  language. 

2.  A  mediocre  command  ol  language. 

1.  A  |<our  command  of  laiigiioge  resulting  In  eiplanatlnns  which  art 
usually  rather  confused. 

Statistical  analysis  of  tho  data  derived  from  this  administration 
indicated  that  of  tho  threo  scales,  only  tho  student’s  rnting  scalo 
showed  promiso  of  giving  sufficiently  reliable  results.  Tho  reliability 
of  the  student’s  scale  when  tho  ratings  of  an  instructor  by  ono  student 
were  correlated  with  tho  ratings  of  that  instructor  ,-y  another  student 
was  0.33.  In  a  samplo  of  44  instructors,  tho  reliability  increased  to 
0.44  when  the  ratings  of  two  students  wero  correlated  with  tho  ratings 
of  two  other  students  of  tho  same  instructor.  This  is  approximately 
tho  increase  in  reliability  that  is  predicted  by  tho  Spearman-Brown 
formula. 

Difficulty  was  experienced  in  obtaining  enough  ratings  of  instructors 
by  supervisors  to  do  an  adequate  statistical  analysis,  but  the  reliability 
of  the  whole  scale  (  —  0.09)  and  of  the  individual  items  proved  to  bo 
so  low  that  this  form  of  supervisor's  scale  was  abandoned  ns  im¬ 
practical.  The  low  reliabilities  of  the  items  of  tho  scale,  half  of  which 
were  negative  and  only  one  of  which  was  substantially  positive,  may 
be  interpreted  in  the  light  of  the  fact  that  most  supervisors  are  unable 
to  ride  with  the  instructor  and  student  in  the  teaching  situation,  and 
thus  do  not  have  an  opportunity  to  make  good  observations  of  tho 
instructor’s  teaching  ability.  This  consideration  and  tho  low  relia¬ 
bilities  obtained  led  to  the  decision  to  secure  ratings  of  instructors  by 
supervisors  on  only  two  items:  (1)  Over-all  flying  piofieieney,  and 
(2)  over-all  value  as  an  instructor. 

Since  it  was  impossible  to  correlate  one  group  of  ratings  on  tho 
self-rating  scale  against  another,  total  scores  on  the  self-rating  scalo 
were  correlated  with  total  scores  of  the  students’  ratings  of  the  satno 
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instructor.  The  avciage  total  score  of  4  students’  ratings  of  an 
instructor  on  a  sample  of  44  instructors  was  correlated  with  the 
instructors  self-ratings  and  gave  a  coefficient  of  0.12.  It  was  judged 
that  revision  of  the  scale  would  not  substantially  raise  the  correlation 
so  no  further  effort  was  expended  in  developing  this  scalo.  Further 
work  along  this  line  was  limited  lo  securing  the  one  rating  on  which  it 
was  thought  the  instructor’s  own  opinion  would  be  most  significant, 
namely,  a  rating  of  his  liking  for  the  job  of  flying  instructor. 

Since  students  have  the  best  opportunity  to  observo  the  instructor’s 
teaching  and  since  the  results  on  the  student’s  rating  scale  were  most 
promising,  further  work  was  concentrated  on  developing  and  refining 
this  scale. 

DEVELOPMENT  OF  STUDENT’S  RATING  SCALE  » 

Refining  and  Shortening  of  Student’s  Rating  Scale 

Work  on  the  development  of  the  student  scale  was  carried  on  at  tho 
Advanced  and  Transition  school  level  because  it  was  believed  that 
the  students  with  more  experience  would  be  better  able  to  rate  their 
instructors  and  since  it  was  known  that  such  students  give  a  better 
distribution  of  responses  than  thoso  in  Primary  schools.  Further¬ 
more,  it  was  known  that  returned  combat  pilots  would  first  be  in¬ 
structing  at  the  advanced  and  transition  levels,  and  the  scalo  was  to 
be  used  primarily  for  collecting  data  on  theso  men  for  validating  the 
battery  of  instructor  selection  tests  being  administered  at  redistribu¬ 
tion  stations. 

The  reliability  of  each  of  the  items  in  the  47-item  student’s  rating 
scale  was  determined.  For  the  purposo  of  determining  item  relia¬ 
bilities,  all  available  pairs  of  students’  ratings  secured  at  Fort  Worth 
Army  Air  Field  were  used,  a  total  of  103  randomly  matched  pairs. 
The  reliability  of  tho  individual  items  ranged  from  0.08  to  0.43. 
Thirty-four  of  the  items  had  a  reliability  abovo  0.10. 

The  34  items  with  a  reliability  abovo  0.10  wero  selected  for  further 
screening  and  refinement.  Where  it  seemed  desirable,  tho  wording 
was  changed  to  improve  tho  clarity  of  tho  alternatives  and  tho  dis¬ 
tribution  of  responses.  In  order  to  refino  this  scalo  further,  it  was 
desired  to  eliminate  thoso  items  which  cither  (1)  had  tho  lowest  relia¬ 
bility,  or  (2)  had  tho  most  overlapping  with  other  items  in  tho  scalo. 
Therefore,  the  scalo  was  administered  to  3G4  students  in  tho  four- 
engine  Transition  school  at  Fort  Worth  Army  Air  Field  and  tho  reliability 
of  each  item  and  its  intercorrelation  with  all  of  tho  other  items  was 
calculated.  Tho  reliabilities  wero  calculated  from  158  randomly 
matched  pairs  of  students  who  wero  taught  by  tho  samo  instructors; 

*  The  major  work  In  the  development  sad  useoMheratinf  sente  was  done  by  Set.  Daniel  J.  Orler.  Addi¬ 
tional  contributor*  were:  S/Set.  C.  P.  Oershensoo  ami  Sgt.  James  Stratton  (HIM  tabulation*  and  statistics}; 
Lt.  J.  W.  Nysard  (preliminary  work);  Cpls.  Oeorye  Farenacht,  Calmer  Tibbetts  Alvin  Roltblatt,  Robert 
Smith,  William  Wloscnlx’rjr,  leonard  Nleder,  ami  Ralph  Wurat  (machine  calculators).  The  project  wa* 
under  the  supervision  o(  1st  Lt.  William  E.  OtlL 
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the  intereorrclations  wero  calculated  from  tho  entlro  sample  of  364 
students’  ratings. 

It  was  found  that  the  changes  in  wording  had  generally  improved 
t lie  distribution  of  tho  ratings.  Discarding  tho  most  unreliable 
items  of  the  47-itcm  scale  had  not  only  shortened  it  but  also  increased 
the  reliability  of  the  total  scale  from  0.33  to  0.36.  The  intcrcorro- 
lations  of  the  items  in  this  scale  ranged  from  0.04  to  0.G2.  They  aro 
not  presented  in  detail  at  this  point,  however,  sinco  the  intercom)- 
lation  among  tho  18  items  of  the  final  scalo  wero  computed  on  a  much 
larger  sample  and  aro  presented  later.  Tho  reliability  of  each  item 
of  tho  scale  is  presented  in  tablo  14.4. 


Taulk  14.4. — Reliabilities  of  each  item  of  3.', -item  form  of  student's  rating  scale  of 

flying  instructors  N=*  168 


First  rating  I  Second  rating 


Mean  RD  Mean  8D 


Analysis  of  errors  . 

Interest  in  Job  of  instructing  . . . 

Ability  to  demonstrate  maneuvers  . 

Ktfeetiveness  of  on-tlie-grownl  (curbing  . 

I'm*  of  "chewing,”  swearing,  etc.,  In  teaching . 

Knenitraces  students  to  nsk  questions  . 

Hiding  the  controls  . 

Ability  to  express  himself . 

Head  ion  to  improvement  In  flying  . 

Personal  interest  in  the  individual  student . 

I'se  of  flight  time  . 

Kniphasi/es  understanding  of  airplane,  etc . 

Ability  to  adapt  leaeliing  methods  to  students . 

Knrournseliiciit  to  study  Hying  outside  plane  . 

I’ntieme  nnd  self-control  . 

Klleetlveness  in  putting  flying  training  over . 

Willingness  to  rc|ie.it  Instructions  . 

Kniplnvdrcs  tench. ng  through  flair  for  dramatic . 

Stimulation  of  desire  to  fly . 

Teaching  how  to  |>crforin  In  emergencies . 

Correcting  nn  error  during  flight . 

iti  biting  maneuvers  to  eomhat  . 

Docs  not  tell  student  the  "what,”  “why”  ami  "how”. 

Cnurdln  it  mg  of  flight  line,  ground  Instructing  . 

Urn  s  not  tell  students  how  to  correct  errors  . 

I’rei  Islnn  of  maneuvers  . 

Maintenance  of  progress  on  schedule . . .  .... 

Voluntary  extra  help  . . 

Personal  npivarnncv  nnd  |>roniptnrss  . 

Maintaining  proper  teacher  -student  discipline . 

t'se  of  teehulenl  terms  nnd  expressions  . 

Interest  in  teaching  instrument  flying  . 

Kniotional  upset  of  student  due  to  way  of  teaching... 
Flying  skill  (Indeiieinlent  of  Instructor  ability' . . 


Items  which  ntcrcorrelatcd  most  higldy  with  tho  other  items,  had 
the  lowest  reliability,  the  poorest  distribution,  nnd  which  were  judged 
to  be  least  important  wero  eliminated,  and  two  new  items  wero 
added.  This  revised  and  shortened  scalo  of  25  items  was  adminis¬ 
tered  to  upper  class  students  nt  an  Advanced  singlc-cngino  school, 
an  Advanced  two-cnginc  school,  and  a  Transition  school  (Class  45-C 
at  Aloe,  Enid,  and  Liberal  respectively)  to  a  total  of  304  students. 

Reliabilities  were  calculated  separately  for  tho  three  schools  and 
then  combined  by  tho  Fisher  z-transfornintion.  They  aro  based  on 
182  randomly  matched  pairs  of  students.  Tho  reliability  of  tho  items 
ranged  from  —0.05  to  0.45.  Tho  two  new  items,  "confidence  in  this 


airphno”  and  “conduct  as  an  officer,”  had  reliabilities  of  0.10  and 
0.35  respectively.  Tho  reliability  of  tho  total  scalo  was  increased 
to  0.49.  In  the  use  of  this  scale  as  a  criterion  for  validating  instructor 
selection  tests  and  other  research,  ratings  of  about  four  students 
were  averaged.  From  the  Spearman-Brown  formula  it  can  bo  esti¬ 
mated  that  averaging  ratings  of  four  students  should  increase  the 
reliability  of  tho  scalo  to  0.79. 

At  tliis  administration,  students  wero  requested  to  indicato  on  their 
scoro  sheets  tho  five  items  they  considered  most  important  in  tho  scale, 
i.  e.,  tho  items  dealing  with  the  fivo  qualities  most  important  for  flying 
instructors  to  possess.  They  were  also  asked  to  indicato  any  items 
they  felt  should  bo  omitted  from  the  scalo  either  because  they  were 
unimportnnt  or  because  tho  student  did  not  have  tho  proper  basis  to 
rate  his  instructor  on  tliis  quality.  The  six  items  that  wero  most 
often  chosen  ns  being  among  tho  fivo  most  important  qualities  were 
presented  in  tnblo  14.2  in  tho  section  on  job  analysis.  An  cxamplo  of 
a  suggested  omission  was  that  the  item  on  “stimulation  cf  tho  student’s 
dcsiro  to  fly”  should  bo  omitted,  as  tliis  quality  in  an  instructor  was 
considered  to  bo  unimportant  at  tho  Advanced  and  Transition  school 
lovol. 

On  tho  basis  of  tbeso  comments  and  suggestions,  together  with  dis¬ 
tributions  of  items,  item  reliabilities  and  intcrcorrclations,  tho  scale 
was  further  cut  to  the  18  most  important  and  rcliablo  items.  It  was 
now  considered  suitablo  as  a  tool  to  bo  used  in  tho  validation  of  the 
instructor  selection  tests. 

Reliability  of  Final  Form  of  Student’s  Rating  Scale 

Tho  final  13-itein  form  of  tho  student’s  rating  scalo  was  designed  to 
securo  ratings  on  instructors  by  advanced  and  transition  school  stu¬ 
dents.  Exploratory  results  lmd  shown  that  such  students  with  more 
experience  would  bo  better  able  to  rato  their  instructors  nnd  exploratory 
results  had  confirmed  this  hypothesis. 

Tho  valuo  of  the  scale  was  tested  out  at  all  levels  of  training  nnd 
the  scale  was  administered  to  all  students  in  Advanced  nnd  Transition 
schools  for  four  successive  classes  beginning  with  class  45-D,  nnd  to  nil 
students  in  basic  schools  for  two  successive  classes  beginning  with 
class  45-11,  for  the  purpose  of  obtaining  criterion  data  against  which 
to  validate  tho  battery  of  instructor  selection  tests  administered  to 
returned  combat  pilots  at  redistribution  stations. 

Distributions  of  responses  on  each  item  of  the  scale  were  tallied  for 
210  primary  students,  355  basic  students,  387  advanced  students,  nnd 
284  transition  students.  Tho  percentage  of  students  selecting  each 
alternative  on  each  item  is  presented  in  table  14.5.  It  will  bo  seen 
that  in  general  tho  distributions  for  primary  students  arc  not  ns  satis¬ 
factory  ns  for  students  at  tho  more  advanced  levels  of  training.  They 
are  considerably  better,  however,  than  tho  distributions  reported  by 
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Lt.  Col.  It.  T.  Sollenbcrger  on  a  9-item  scale  which  he  administered  to 
primary  students  at  Stamford  Flying  School,  Arledgc  Field,  Stamford, 
Tex.,  in  September  1943. 

Tabu:  14.5. — Reliability  of  total  score  and  distribution  of  responses  of  Elementary, 
Basic,  Advanced,  and  Transition  students  on  IS-item  student's  rating  scale 


Reliability ' 


Distribution 


„  m  State- 
lffra  tnent 
N°*  No. 


Elemen¬ 

tary 

Raslo 

Ad¬ 

vanced 

Transi¬ 

tion 

r-.  27 
A'-fig 

r-.fiO 

.V-233 

r-M 
AT- 782 

r-.M 
AT— All 

Af-210 

A' -353 

AT- 387 

Af-284 

Percent  Percent 
1  2 


Percent 

1 


Item  and  rue  statement* 


Percent 

1 


1.  Anatiiltoferron.— This  Instructor— 
Merely  says  the  maneuver  Is  wrong  but 

doesn't  say  why. 

Is  somewhat  Indefinite  about  wbat  Is  wrong 
and  how  to  correct  It. 

Gives  a  fairly  Rood  Idea  of  what  Is  wrong 
ami  how  to  correct  It. 

Locates  the  »|>eelflc  cause  of  the  difficulty 
and  tells  exactly  how  to  correct  It. 

2.  Interrrt  fa  Job  of  Intlruellnt.—’ This  In* 

structor— 

Is  eitreinely  enthusiastic  about  hts  Job. 
Seems  very  Interested  In  his  Job. 

Is  Interested  In  Ills  Job  but  not  enthusiastic. 
Sho«s  sIIrIiI  Interest  In  Instructing. 

3.  Ability  to  demonitrate  maneuren  In  the 

air.— This  Instructor's  demonstrations 
of  flying  aro— 

An  excellent  example. 

A  very  good  example. 

A  Rood  rxample. 

A  satisfactory  example. 

4.  Pfftdiirnrn  of  on-the  ground  teaching.— In 

general,  the  discussion  w  hich  this  Instruc¬ 
tor  gives  before  and  after  the  flight— 
Could  he  r really  Improved  upon. 

Is  somewhat  Inadequate. 

Is  fairly  good. 

Is  thorough  an<l  excellent. 

5.  Cte  of  "chewing,"  nifirlnt,  ridicule,  or 
enronm  fa  frarMag.— This  Instructor  uses 
such  methods— 

Only  when  absolutely  necessary. 
Occasionally  when  unnecessary. 

A  great  di  at  of  the  time. 

Almost  nil  of  the  time. 

fl,  Pncourngei  itudente  to  «<l  f ueiffons.— 
This  Instructor— 

Made  me  feel  I  should  not  ask  questions. 
Neither  encourages  nor  dlscourngrs  ques- 
lions. 

Seemed  lo  want  mo  to  ask  quest  Ions  If  I  did 
not  understand. 

Definitely  encourages  me  lo  a»k  questions. 
7.  I’iding  the  coiitroly.— This  Instructor  take* 
over— 

Only  when  lives  or  Planes  are  endangered. 
Occasionally  when  fl  scvirs  unnecessary. 
Considerably  more  often  than  necessary. 

On  the  slightest  provocation, 
fl.  Ability  to  rrjrur  hhntrlf. — The  ex  plana- 
lions  which  thLs  Instructor  give*— 

Tend  to  Ic  rather  confused. 

Are  Mimrtlim  s  hard  lo  understand. 

Are  lists  ally  fairly  ele.tr. 

Are  always  |>-rfeelly  clear. 

9.  Itroclion  to  Imjirceeni'n t  In  /firing.  —  Whets 
I  show  Improvement  this  Instructor— 
Always  Us  me  know  I  hue  done  well, 
horn,  times  k  ts  me  know  I  have  .lone  well. 
Rarely  lets  me  knt»w  I  h  ive  done  well. 

A Imost  laser  lets  inrkltow  Ihj.vduneWfU. 


Sec  footnote  at  end  of  table. 
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Taulk  14.5. — Reliability  of  total  score  and  distribution  of  responses  of  Elementary 
Basic,  Advanced,  and  Transition  students  on  18-item  student’s  rating  scale — Con.  ’ 


Elemen¬ 

tary 

Uaste 

Ad¬ 

vanced 

Transi¬ 

tion 

t- n 
N-CA 

r-.60 

•V-233 

r-.36 

tv-782 

r-.SS 

tf-011 

Item  and  cue  statements 

Distribution 

Item 

No. 

State¬ 

ment 

No. 

O 

w 

1 

TV-358 

TV- 387 

TV-284 

1 

Percent 

7 

Percent 

10 

Percent 

10 

Percent 

7 

10.  Personal  Interest  In  the  tndlildual  student.— 
This  instructor  takes— 

Little  personal  Interest  In  the  Individual 

JO . 

2 

32 

22 

21 

22 

student. 

Some  |>ersonal  Interest. 

3 

35 

44 

45 

40 

Quite  n  hit  of  tx-rsonal  Interest. 

4 

36 

24 

24 

31 

A  great  jicrsonal  Interest. 

4 

70 

48 

55 

40 

11.  L’lf  of  flight  time. — This  Instructor- 
Makes  ciccpt  tonally  good,  well-planned  use 

11 . 

3 

28 

44 

39 

40 

of  time. 

Makes  pood  use  of  the  time. 

3 

2 

8 

5 

11 

Makes  (air  use  of  the  time. 

1 

0 

1 

1 

3 

Makes  poor  use  of  time,  tends  to  waste  It. 

1 

6 

4 

3 

5 

12.  Emphasises  an  understanding  of  the  air¬ 
plane,  flging  safety,  and  flying  regulations.— 
Tills  instructor  teaches  thu— 

With  Incidental  emphasis  while  teaching 

I* . 

3 

17 

21 

20 

24 

flying  procedure. 

With  considerable  emphasis. 

1 

33 

32 

30 

38 

With  great  emphasis. 

4 

45 

43 

41 

33 

As  one  or  the  most  Important  fcoturcsof  flying. 

4 

45 

52 

56 

51 

13.  Conduct  as  an  officer. — The  behavior  of 
this  Instructor  oh  the  ground  and  In  tbe 
air  In  all  res|»ecls — 

Sets  nn  excellent  example  for  the  student. 

13 . 

7 

40 

36 

33 

35 

Sets  a  pood  example  for  the  student. 

3 

13 

12 

8 

12 

Sets  a  fairly  pood  example  for  the  student. 

1 

3 

1 

3 

2 

Sol  s  a  some*  hat  poor  example  for  the  student. 

4 

47 

30 

43 

30 

14.  /Unlit u to  understand  the  protslemsol  the  Indi- 
ridtirl  student  and  adapt  teaching  methods 
to  Aim.— This  Instructor— 

Always  seems  to  adapt  hto  methods  to  my 

U . 

3 

37 

45 

38 

39 

ivonlrms. 

Often  seems  to  a<lnpt  to  iny  problems. 

3 

10 

13 

14 

in 

Fomctinirs  seems  to  adapt  to  my  problems. 

1 

7 

0 

6 

8 

Hardy  seems  to  change  hto  methods  to  Ot 

f  » 

30 

6 

8 

0 

my  problems. 

15.  Encourage  meat  to  study  flyiny  outride  the 
airplane  (use  of  flight  manuals,  technical 
orders,  tie.) -In  petting  students  to  usa 
these  materials  this  Instructor- 
rays  little  attention  to  It. 

16 . 

I  3 

10 

0 

13 

14 

Is  relatively  hielTcctlva. 

1  3 

44 

47 

62 

55 

Is  fairly  ctTecllva. 

1  4 

37 

39 

30 

25 

Is  very  effective. 

4 

91 

07 

70 

67 

16.  Confidence  In  this  airplane.— This  In¬ 
structor- 

Displays  absolute  confidence  In  his  ability 

3 

8 

27 

30 

27 

to  meet  all  cincrpendes  In  this  airplane. 
Seems  unite  confident  Inhlsahlllty  to  meet 

18. . 

a 

0 

4 

*  4 

6 

all  emergencies  In  this  airplane. 

Seems  fairly  confident  inhlsahlllty  to  meet 

l 

1 

3 

0 

1 

all  ciiierpenrles  In  this  airplane. 

Seems  doubtful  ubout  hto  ability  to  meet 

|  i 

3 

4 

3 

4 

all  emergencies  In  this  airplane. 

17.  Patience  and  self-control. — This  instruc¬ 
tor  to— 

Extremely  Impatient. 

IT . 

3 

9 

13 

8 

11 

Somewhat  Impatient. 

3 

31 

29 

25 

20 

Hat  her  patient. 

l  4 

58 

54 

04 

60 

Extremely  patient. 

4 

43 

23 

40 

29 

18.  Effectirenest  In  pulling  flying  training 
across.— This  Instructor's  over-oil  effec¬ 
tiveness  to— 

Exceptionally  hleh— he  opiroachej  th# 

18 . 

3 

46 

43 

45 

43 

Ideal  as  s  trachcr. 

Very  high— a  very  good  teacher. 

a 

10 

23 

13 

22 

Cood-un  adequate  teacher. 

1 

8 

3 

5 

Limited— a  fair  teacher. 

•  The  reliability  figure  to  based  on  the  correlation  of  the  rating  of  an  Instructor  by  I  student  with  tb* 
rstlng  of  Cie  same  Instructor  by  itnuthcr  student  In  the  same  clast. 


The  reliability  of  the  student’s  rating  scale  was  determined  in  two 
different  ways— intraclass  and  interclass  reliability.  The  latter  of 
these  two  is  the  more  rigorous  test  of  reliability  since  there  is  littlo 
possibility  for  students  in  successive  classes  to  influence  each  other 
in  the  evaluation  of  their  instructor. 

Agreement  among  students  in  same  class. — The  reliability  of  the  total 
scale  when  two  students  in  the  same  class  rating  the  same  instructor 
arc  randomly  paired  and  the  rating  of  one  student  is  correlated  with 
the  rating  of  the  other  student  is  presented  in  table  14.4.  The  reli¬ 
ability  of  the  scale  was  computed  from  data  gathered  at  three  primary 
schools,  four  basic  schools,  seven  advanced  schools  (single-engine  and 
two-engine),  and  nine  transition  schools.  The  reliability  of  the  scale 
for  each  school  was  computed  separately  and  the  reliabilities  for  all 
schools  at  a  given  level  of  training  were  combined  by  Fisher’s  z-trans- 
formation.  The  reliabilities  were  as  follows  for  the  different  levels  of 
training:  Primary  (N  =  GS)  0.27;  Basic  (Ar=233)  0.G0;  Advanced 
(AT=7S2)  0.3G;  Transition  (N=613)  0.55.  Use  of  the  Spearman- 
Brown  formula  for  predicting  the  reliability  of  the  scalo  when  4  stu¬ 
dents  rato  the  same  instructor  raises  the  reliability  to  0.00  for  primary 
schools,  O.SG  for  basic  schools,  0.G9  for  advanced  schools  (singlo- 
enginc  and  two-engine  combined),  and  0.S3  for  transition  schools. 
In  general,  the  reliability  of  the  scale  at  all  levels  of  training  was 
satisfactory.  Although  the  reliability  for  primary  students  was  not 
as  high  as  it  was  for  students  at  the  more  advanced  levels  of  training, 
probably  because  of  the  inexperience  of  tho  students,  tho  scale  is  still 
useful  as  a  measure  of  the  instructor's  ability,  particularly  if  at  least 
four  independent  ratings  of  an  instructor  arc  combined. 

Agreement  among  students  in  different  classes. — Administration  of  tho 
student’s  rating  scale  to  four  successive  classes  in  advanced  and  transi¬ 
tion  schools  made  it  possible  to  make  a  final  check  on  the  reliability 
of  the  scale  by  comparing  scores  on  a  single  instructor  rated  by  stu¬ 
dents  from  different  classes.  This  decreased  the  possibility  of  ft  lack 
of  independence  in  ratings,  since  students  of  one  class  would  not  bo 
likely  to  influence  the  judgments  of  students  in  another  class  in  rating 
the  instructors. 

A  total  of  2S1  instructors  were  found  in  the  data  who  had  been  rated 
by  students  from  two  classes.  An  average  of  3.25  students  in  cncli 
class  rated  eftch  instructor.  There  were  159  Advanced  school  in¬ 
structors  and  122  transition  school  instructors  in  the  group  on  which 
the  class-to-class  reliability  of  tho  scale  was  computed.  Tho  total 
scores  on  the  scalo  were  first  normalized  and  converted  into  standard 
scores  ranging  from  1-9.  Using  these  standard  scores,  the  class-to- 
class  reliability  of  tho  scale  was  then  computed.  Tho  reliability  of 
tho  scale  computed  in  this  manner  was  0.36. 

Comparison  oj  two  types  oj  reliability. — In  order  to  determino  tho 
amount  of  shrinkage  in  clftss-to-class  reliability,  tho  percentage  of  tho 
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277  instructors  coming  from  each  school  was  computed  and  tho  intra- 
class  reliability  of  that  school  was  converted  to  a  z-transformation. 
It  was  necessary  to  drop  4  of  tho  original  281  instructors  since  they 
were  from  schools  which  had  not  provided  sufficient  material  upon 
which  to  calculate  intraclass  reliabilities.  The  intiaclass  reliabilities 
of  nil  schools  w  ore  then  combined  on  the  basis  of  having  the  percentage 
of  instructors  from  each  school  tho  samo  ns  in  tho  samplo  of  277  on 
which  the  class-to-class  reliability  was  computed.  This  gave  an 
intraclass  reliability  of  0.49  when  tho  rating  of  an  instructor  was  made 
by  two  students  and  tho  rating  of  ono  student  was  correlated  with 
that  of  the  other.  Use  of  the  Spearman-Brown  formula  for  predicting 
the  reliability  of  the  scale  when  an  average  of  3.25  students  rate  tho 
same  instructor  (as  in  tho  class-to-class  study)  raises  the  intraclass 
reliability  to  0.75.  The  comparative  shrinkage  from  intraclass  to 
interclass  reliability  is,  then,  from  0.75  to  0.36.  Two  factors  are 
probably  responsible  for  this  shrinkage  in  reliability  when  tho  moro 
rigorous  test  of  class-to-class  reliability  is  applied:  (1)  The  students 
do  not  have  a  chance  to  influence  each  other  in  tho  rating  of  an  in¬ 
structor  and  (2)  the  instructor  may  himself  change  in  his  teaching 
from  class  to  class. 

The  class-to-class  reliability  of  tho  over-all  item  of  tho  student’s 
rating  scale,  “Effectiveness  in  putting  flying  training  across,”  was  0.23. 
Sinco  the  class-to-class  reliability  of  total  scores  on  tho  scale  was  0.36, 
tho  total  score  has  a  significantly  higher  reliability  (1  percent  level  or 
better)  than  the  over-all  item  alone.  Furthermore,  the  over-all  item 
probably  had  a  higher  reliability  in  this  study  where  tho  instructor 
was  rated  on  it  after  he  had  been  rated  on  tho  other  17  items  of  tho 
scale  than  it  would  have  had  if  it  had  been  tho  only  item  on  which  tho 
instructors  wero  evaluated. 

Intcrcorrclation  Among  Items  on  Student's  Scale 

Using  students’  ratings  secured  on  1,141  advanced  and  transition 
school  instructors,  the  intercorrelations  of  tho  items  of  tho  scalo  were 
computed.  An  average  of  3.12  students  rated  each  instructor,  and 
the  average  rating  of  each  instructor  on  each  item  w’as  used  in  calcu¬ 
lating  tho  item  intercorrelations.  Tho  total  scores  wero  normalized 
and  converted  into  standard  scores  ranging  from  1  to  9  beforo  tho 
intercorrelations  were  run.  Tho  intercorrelation  of  each  item  with 
every  other  item  and  with  total  score,  supervisor’s  rating  of  flying 
ability,  and  supervisor's  rating  of  instructor  proficiency  aro  presented 
in  table  14.6.  It  will  be  seen  that  tho  intercorrelations  among  items 
range  from  0.12  to  0.76  which  indicates  that  although  tho  different 
qualities  being  rated  in  tho  instructor  aro  related  to  each  other,  many 
of  them  make  separate  contributions  to  tho  total  evaluation  of  an 
instructor. 
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Table  14.6. — Intercorrelalions  among  item s  of  18-item  student ’*  rating  scale  and  supervisor’s  over-all  ratings 

N  =  114I;  SE  of  a  zero  correlation =0.03 
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In  general,  the  items  which  one  would  logically  expect  to  bo  related 
had  the  highest  intcrcorrclations  and  those  which  ono  would  expect 
to  be  unrelated  gave  low  intcrcorrclations.  For  examplo,  “use  of 
"chewing/  swearing,  ridicule,  etc.,  in  teaching”  correlated  0.67  with 
“patience  and  self-control”  and  0.46  with  “ability  to  understand  tho 
problems  of  the  individual  student”  but  only  0.15  with  “confidence 
in  this  airplane.”  Since  the  signs  of  all  coefficients  have  been  adjusted 
so  that  a  positive  ono  means  a  positive  relationship  between  good 
qualities,  this  means  that  the  instructors  who  did  not  swear  at  their 
students  were  considered  to  bo  tho  most  patient.  Fortunately,  a 
strong  “halo”  effect,  causing  tho  students  to  givo  indiscriminately 
higher  ratings  on  all  items  to  the  instructors  they  liked,  did  not  seem 
to  be  present.  This  is  shown  by  the  fact  that  the  instructors  who  were 
rated  highest  on  not  swearing  were  not  necessarily  given  a  higher 
rating  on  their  confidence  in  tho  airplane. 

In  order  to  secure  a  rough  cstimnto  of  which  items  of  tho  rating 
scale  were  related  to  each  other  and  what  moro  generalized  factors  tho 
rating  scale  measured,  profiles  presenting  graphically  the  correlation 
of  each  item  with  every  other  item  of  the  rating  scale  were  constructed. 
An  inspection  of  these  graphs  showed  that  tho  items  could  bo  sorted 
into  the  following  groups  on  the  basis  of  similarity  of  thoir  profiles. 

Group  I 

Paticnco  and  self-control. 

Ability  to  understand  tho  problems  of  tho  individual  student  and 
adapt  teaching  methods  to  him. 

Use  of  “chewing,”  swearing,  ridicule,  or  sarcasm  in  teaching. 

Riding  tho  controls. 

Group  II 

Interest  in  job  of  instructing. 

Encouragement  to  study  flying  outside  tho  airplano  (uso  of  flight 
manuals,  tech  orders,  etc.). 

Emphasizes  an  understanding  of  tho  airplane,  flying  safety,  and  flying 
regulations. 

Uso  of  flight  time. 

Group  III 

Ability  to  express  himself. 

Analysis  of  errors. 

Encourages  students  to  ask  questions. 

Ability  to  demonstrate  maneuvers  in  tho  air. 

The  general  factor  underlying  the  items  in  group  I  might  bo  con¬ 
sidered  as  a  personality  factor  involving  paticnco  and  social  adapta¬ 
bility.  Tho  general  factor  underlying  tho  items  in  group  II  might 
be  described  as  enthusiasm  for  and  a  systematic  approach  to  tho  job 
of  instructing.  Tho  general  factor  which  best  describes  tho  items  in 
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group  III  is  analytic  and  verbal  ability.  The  other  items  of  the  scalo 
did  not  definitely  fit  into  any  of  the  above  groupings.  Tho  profiles 
of  the  items  in  the  three  groups  arc  presented  in  figures  14.1  through 
14.3. 

Correlation  Between  Student's  and  Supervisor's  Ratings 

A  study  was  made  of  tho  relationship  of  the  three  measures  later 
used  in  validating  the  battery  of  instructor  selection  tests  adminis¬ 
tered  to  returned  combat  pilots  at  redistribution  stations.  Theso 
threo  measures  were:  (1)  Student’s  averago  total  rating  of  tho  in¬ 
structor  on  tho  18-item  student’s  rating  sealo.  There  was  an  averago 
of  3.12  students  rating  each  instructor;  (2)  supervisor’s  over-all 
rating  of  the  flying  ability  of  the  instructor;  (3)  supervisor’s  over-all 
rating  of  the  instructing  proficiency  of  the  instructor.  Tho  two  latter 
ratings  were  on  a  3-point  scalo  (in  upper  25  percent  of  instructors,  in 
middle  50  percent  of  instructors,  or  in  lower  25  percent  of  instructors 
in  tho  school). 

Intcrcorrclations  computed  between  theso  threo  types  of  measures 
showed  that  thcro  was  littlo  relationship  between  supervisors’  and 
students’  ratings  of  instructor  proficiency  (r=0.08).  Thero  was  also 
littlo  relationship  between  supervisors’  ratings  of  flying  ability  nnd 
students’  ratings  of  instructor  proficiency  (r=0.0G).  Thero  was,  on 
tho  other  hand,  a  close  correspondence  between  supervisors'  ratings 
of  flying  ability  and  their  ratings  of  instructor  proficiency  (r=0.70). 
Theso  correlations  arc  all  based  on  1,141  cases.  Similar  high  correla¬ 
tions  botween  supervisors’  ratings  of  an  instructor’s  flying  nbility 
and  instructing  proficiency  have  been  reported  nt  Primary  flying 
schools  by  Psychological  Research  Unit  No.  2.  It  is  evident  that 
supervisors,  who  often  have  littlo  opportunity  to  observe  the  instructor 
whilo  ho  is  instructing  in  tho  air,  base  their  estimato  of  his  instruc¬ 
tional  nbility  almost  solely  upon  what  they  can  observo,  namely, 
his  flying  proficiency.  Students  nnd  supervisors  diirercd  markedly 
in  their  appraisal  of  an  instructor. 

ANALYSIS  OF  BACKGROUND  FACTORS  RELATED  TO 
INSTRUCTOR  SUCCESS 

In  connection  with  tho  collection  of  criterion  dntn  for  tho  validation 
of  instructor  selection  tests,  personal  data  items  wero  secured  on 
instructors  who  were  subsequently  rated  by  their  students  for  instructor 
proficiency  on  the  18-item  scale  and  by  supervisory  personnel  on  their 
over-all  flying  nbility  nnd  over-all  instructor  proficiency.  This  was 
dono  for  two  reasons:  (1)  It  was  necessary  to  study  tho  eflect  of 
theso  factors  on  tho  ratings  in  order  to  know  whether  or  not  thoy 
must  bo  controlled  in  validating  tho  tests.  For  examplo,  if  tho  men 
who  had  had  ouly  a  small  amount  of  instructing  experience  were 

319 


A 


CORRELATION  PROFILES  OF  ITEMS  OF  GROUP  Z  (For  tocH  r  N -1,141) 


r  •  *  til* 

Hours  lata)  jo  ms 


CORRELATION  PROFILES  OF  ITEMS  OF  GROUP 


(•I  %mrm  *•  «MlllMai  Mlti  «•  «c«  •  •>  l>l«i  in*  taOM  tCu  m3  Ml  fO  • 

mrss  s*rjr»  00  s*m 


Fif.  MS  CORRELATION  PROFILES  OF 


found  to  get  markedly  lower  ratings,  this  group  would  lmvo  to  bo 
treated  separately  in  validating  tho  tests;  (2)  tho  data  in  themselves 
wero  valuable  information.  In  addition  to  being  necessary  for  decid¬ 
ing  which  groups  may  bo  considered  homogeneous  enough  to  bo 
combined  in  the  validation  study,  it  was  believed  that  tho  determi¬ 
nation  of  tho  relationship  of  these  factors  to  tho  proficiency  of  an 
instructor  would  be  of  considerable  valuo  to  tho  Training  Command. 
For  example,  it  should  reveal  whether  or  not  tho  common  supposition 
is  truo  that  instructors  improve  with  cxporicnco  at  first,  and  then  go 
stalo  and  get  poorer  tho  longer  tho  period  of  instructing. 

In  addition  to  identifying  data  such  ns  name,  army  serial  number, 
etc.,  pertinent  information  of  a  biographical,  or  personal,  nnturo 
wore  secured  on  a  total  of  1,284  Advanced  single-engine,  Advanced 
two-engino  and  Transition  school  instructors.  Of  this  number,  404 
wero  rotumed  combat  pilots  and  tho  remaining  880  had  had  no 
combat  experience. 

Method  Used  in  Analysis  of  Data 

Tho  threo  measures  described  in  pago  14-30,  i.  e.,  students'  ratings 
of  teaching  ability,  supervisors'  rating  of  teaching  ability  and  super¬ 
visors’  rating  of  flying  proficiency,  wero  used  ns  criteria  in  evaluating 
tho  personal  data  items.  Tho  distributions  of  responses  on  tho  per¬ 
sonal  data  items  wero  studied  in  relation  to  tho  scores  made  on  these 
measures. 

Tho  average  total  scores  on  tho  18-item  student  rating  scnlo  wore 
first  normalized  and  converted  into  standard  scores  ranging  from  1  to 
9.  Tho  instructors  were  grouped  according  to  tho  various  categories 
of  each  personal  data  item,  for  example,  according  to  tho  number  of 
months  instructing  experience  they  had  had  at  tho  school.  For  each 
of  tho  groups  tho  mean  of  tho  converted  standard  scores  on  tho  18- 
item  student’s  rating  scnlo  was  computed.  Tho  means  of  tho  super¬ 
visors’  ratings  of  teaching  and  of  flying  ability  were  also  computed  for 
each  group.  Graphs  were  then  constructed  showing  tho  relationship 
botween  theso  mean  scores  and  tho  vnrious  divisions  of  each  biograph¬ 
ical  item. 

A  study  of  tho  graphs  and  of  tho  means  for  tho  vnrious  divisions  of 
tho  personal  data  items  showed  that  thero  was  no  significant  trend  in 
tho  relationship  of  students’  or  supervisors’  ratings  to  tho  following 
ones: 

1.  Previous  oxpcricnco  ns  flying  instructor: 

o.  Typo  of  school. 
b.  Typo  of  piano. 

2.  Logged  hours  of  flying — nonmilitary. 

3.  Typo  of  instructing  being  dono  at  present. 

4.  Number  of  combat  hours. 

5.  Typo  of  plane  flown  in  combat. 
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6.  Rcdistriiution  station  to  which  returned  from  combat. 

7.  Date  of  :  nival  at  redistribution  station. 

Theso  items  w  *ro  therefore  not  further  analyzed.  The  data  on  the 
remaining  biographical  items  gave  promise  of  showing  significant 
differences  between  the  means  of  tho  various  subgroups  and  therefore 
wero  tested  by  .lie  analysis  of  variance  technique.  Tho  instructors 
wero  divided  or  tho  basis  of  their  scores  on  each  biographical  item 
into  two  or  thrio  groups  with  approximately  an  equal  number  of 
eases  in  each  group.  These  groupings  were  then  treated  by  the 
analysis  of  variance  technique  to  determine  whether  thero  was  any 
relationship  between  tho  biographical  item  and  the  rating.  The 
F-ratio  test  was  used  to  determine  tho  probability  of  obtaining,  by 
chance,  differences  among  tho  groups  as  largo  as  thoso  observed.  Two 
of  tho  items  thus  tested  failed  to  differentiate  between  tho  subgroups 
at  tho  5  percent  level  of  significance  on  either  students'  ratings, 
supervisors'  ratings  of  teaching  ability  or  supervisors'  ratings  of  flying 
proficiency.  These  items  were:  training  at  a  control  instructors 
school  and  experience  as  a  nonflying  instructor.  All  other  items 
tested  showed  a  reliable  difference  on  one  or  more  of  tho  three  criteria. 

After  tho  relationship  between  tho  personal  data  items  and  tho  total 
score  on  tho  student’s  rating  scalo  had  been  determined,  the  relation* 
ship  between  certain  selected  personal  data  items  and  each  of  the  18 
items  of  tho  scalo  was  computed.  This  moro  detailed  analysis  was 
dono  on  thoso  personal  data  items  which  had  been  found  to  bo  signifi- 
cantly  related  to  tho  total  scoro  on  tho  student's  rating  scale.  To 
theso  wero  added  a  few  personal  data  items  which  seemed  likely  to 
yield  significant  relationships  with  tho  individual  items  on  tho  stu¬ 
dent’s  scalo  even  though  they  wero  not  rclntcd  to  tho  total  score. 

Results  of  Analysis  of  Biographical  Factors 

Tho  results  on  thoso  personal  data  items  which  wero  selected  for  the 
moro  detailed  analysis  are  presented  in  tablo  14.7.  Tho  results  for 
tho  other  personal  data  items  which  were  analyzed  in  less  detail  nro 
presented  in  table  14.8.  Tho  relationships  of  the  most  significant 
personal  data  items  to  the  total  score  on  tho  student’s  scalo  and  to 
tho  two  supervisors’  ratings  arc  presented  graphically  in  figures  14.4 
to  14.12. 

Tho  main  findings  on  each  of  the  personal  data  items  which  yielded 
significant  results  were  ns  follows: 

length  of  time  as  flying  instructor. — All  of  the  items  of  tho  student’s 
rating  scalo  on  which  the  instructors  with  moro  months  of  teaching  at 
tho  same  station  wero  rated  os  significantly  better  than  thoso  with 
less  months,  were  items  which  dealt  with  tho  technical  aspects  of 
instructing.  They  wero:  confidence  in  this  airplane;  ability  to 
demonstrate  maneuvers;  analysis  of  errors;  ability  to  express  himself; 
on-the-ground  teaching  effectiveness;  use  of  flight  tiino;  emphasis  on 
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an  understanding  of  tho  airplane,  etc.;  encouragement  to  study 
flying  outside  the  nirplano;  and  tho  over-all  item,  effectiveness  in 
putting  flying  training  across.  All  of  tho  items  on  which  tho  instruc¬ 
tors  with  more  teaching  experience  were  rated  as  significantly  poorer 
than  those  with  less  experience,  were  items  dealing  with  tho  personal 
aspects  of  instructing.  They  were:  use  of  “chewing,"  sarcasm, 
swearing,  etc.;  paticnco  and  self-control;  reaction  to  improvement  in 
flying;  and  personal  interest  in  tho  student. 


rt*.  i4.» 

SANK  V£  RATINGS  OF  FLYING  INSTRUCTORS 

« 


TOTAL  NUMBER  OF  MONTHS  OF  INSTRUCTING 
EXPERIENCE  ¥£  RATINGS  OF 
FLYING  INSTRUCTORS 

*—  •  —  S.f.r^r'i  mi  •  ThiHi| 

—  -  Va.f 'if**',  mi-n -Fir— « 


326 


LIKING  FOR  JOO  OF  F LYING  INSTRUCTOR  VS.  RATINGS  Of  flYlNG  INSTRUCTORS 


fir  RilWsf;  tf  •  S  0.  t  0  •  f  6 


It  would  seem  that  as  ho  spends  moro  timo  teaching  flying,,  the 
instructor  improves  in  the  technical  aspects  of  instructing  but  at  the 
same  timo  tends  to  bccomo  moro  irritablo  and  impatient.  On  the 
other  hand,  it  is  possiblo,  of  course,  that  tho  instructors  find  this 
“hard-boiled”  attitudo  moro  effective  in  turning  out  good  students. 
It  would  bo  interesting  to  have  a  group  of  experienced  instructors 
rated  on  thoso  two  types  of  items,  technical  and  personality,  before 
and  after  being  given  a  rest  from  teaching  flying  by  temporary  rotation 
to  somo  other  assignment. 

Tho  total  scoro  on  tho  studont’s  rating  scale  did  not  show  any 
diffcrcnco  between  tho  instructors  with  moro  and  with  less  months  of 
cxpcrionco  at  that  station.  This  is  accounted  for  by  tho  fact  that 
tho  instructors  with  moro  cxpcricnco  were  rated  as  reliably  better  on 
somo  items  of  tho  scalo  and  reliably  poorer  on  others. 

In  general,  supervisors  rated  the  instructors  with  a  greater  number 
of  months  instructing  at  that  station  as  both  better  teachers  and 
better  flyers  than  thoso  with  fewer  months.  This  seems  reasonable, 
sinco  in  making  his  judgment,  tho  supervisor  would  naturally  bo 
guided  more  by  factors  of  technique  and  less  by  tho  student-instructor 
relationship  which  ho  would  havo  littlo  opportunity  to  observo. 

Tho  preceding  analysis  has  been  based  on  number  of  months 
instructing  at  tho  samo  station.  Similar  results  on  tho  student's 
total  scoro  and  on  tho  supervisors’  two  ratings  were  also  obtained  for 
tho  total  number  of  months  instiucting  experience  at  all  stations. 
Theso  results  aro  presented  graphically  in  figure  14.6.  In  this  figure 
it  can  bo  seen  that  although,  in  general,  tho  instructors  with  more 
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cxpericnco  aro  given  tho  higher  ratings  by  tlio  supervisors,  there  is 
somo  tendency  for  those  who  havo  been  instructing  more  than  two 
years  to  bo  given  lower  ratings  on  teaching  ability  than  thoso  who 
havo  been  instructing  from  20  months  to  2  years.  This  tendency  for 
a  reversal  at  tho  far  end  of  tho  curvo  was  found  to  bo  rcliablo  at  tho 
1  percent  level.  This  appears  to  confirm  tho  widespread  opinion  that 
flying  instructors  tend  to  go  "stalo”  after  teaching  flying  too  long. 
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Convincing  proof  would  require  a  contrast  of  possiblo  sclcctivo 
factors  differentiating  the  groups  with  differing  experience. 

Combat  service. — Eleven  of  tho  items  of  tho  student's  rating  8calo  on 
which  tho  instructors  with  combat  scrvico  wero  rated  os  significantly 
better  than  those  without  combat  scrvico  wero  ones  dealing  with 
paticnco  and  self-control  and  tho  student-instructor  relationship. 
They  were:  use  of  “chewing/’ sarcasm,  swearing,  etc.;  paticnco  and 
self-control;  reaction  it*  improvement  in  flying;  and  personal  interest 


in  the  student.  All  rt  the  itoms  on  which  tho  instructors  with  combat 
experience  wero  ratcc  as  significantly  lower  than  thoso  without  combat 
experience  were  items  dealing  with  tho  technical  aspects  of  instructing. 
They  wero:  ability  to  express  himself ;  on-thc-ground  teaching  effective¬ 
ness;  and  use  of  flight  time. 

It  will  bo  noticed  that  tho  difference  botween  combat  roturnccs  and 
nonreturnees  is  similar  to  tho  one  between  tho  less  and  moro  experienced 
instructors,  except  that  in  tho  latter  ease,  statistically  rcliablo  differ¬ 
ences  were  secured  for  moro  of  tho  items  in  tho  studont’s  scale.  Tho 
similarity  of  tho  results  for  theso  variables  is  not  surprising  since,  in 
general,  tho  combat  returnees  had  less  teaching  experience  than  tho 
nonrctumces. 

The  total  scoro  on  tho  student’s  rating  scalo  gave  tho  instructors 
with  combat  scrvico  a  reliably  higher  rating  than  thoso  without 
combat  scrvico.  Supervisors,  on  tho  other  hand,  rated  nonrctumces 
ns  both  better  teachers  and  better  flyers.  This  seems  logical  sinco 
tho  nonrctumces  appeared  to  bo  better  in  aspects  of  instructing  such 
ns  uso  of  flight  time  and  ability  to  oxpress  themselves,  which  nro 
easier  for  tho  supervisor  to  obsorve. 


Taiilk  14.8. — Relationship  of  additional  items  oj  personal  data  to  total  score  on 
student’s  rating  scale  oj  teaching  proficiency  and  to  supervisor’s  ratings 


D  leg  raph  leal  Itemi 


Marital  status: 

a.  Single . 

0.  Married,  no  eMMren, 

wife  with  you. . 

t.  Married,  with  children, 

wife  with  you  . 

Loggial  hours  mlMtmy  flying: 

a.  0  W/i  hours . 

h.  1 100 to  ll'00  +  hours.... 
O.  I.  H  training: 

а.  None  or  local  school _ 

б.  All  C.  I.  S  . 

Exi'orlrnca  nonflying  In- 

•tnicior: 

a.  Nona  to  less  than  4 

months . 

ft.  (t  mouths  to  J  years . 

Total  Instructor  esperlence: 

а.  Icm  than  I  month . 

б.  I  t  mouths . 

t.  5  9  mouths . 

4.  10  It  months . 

t.  IS  19  months . 

/.  20  21  months . 

f.  Over  3  years . 


Supervisors*  rating- 
instructing 


P-rmlrA-llity  of  obtaining  by  chance  alone  a  difference  of  this  magnitude.  A  "P”  of  0.01  means  that  lb* 

_ ..  •!.  .  a»__  _  a  Il.t  . . I  1 _ A  _  _» _ #  .  _  A _ -  a-  t _ .  Ak.A  «  I  .A  IM 


Military  rank  oj  instructor. — Tho  items  of  tho  student’s  rating  scalo 
on  which  tho  instructors  with  higher  military  rank  wero  rated  as 
reliably  better  than  thoso  with  lower  rank  wero  ones  dealing  with 
patienco  and  self-control  and  tho  student-instructor  relationships 
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They  were:  uso  of  "chewing,”  sarcasm,  swearing,  etc.;  reaction  to 
improvement  in  flying;  personal  interest  in  the  student;  and  conduct 
as  an  officer.  Thero  wero  only  two  items  on  which  tho  higher  ranking 
officers  wero  rated  ns  reliably  pooler  than  tho  lower  ranking  ones. 
Thcso  were:  encouragement  of  student  to  ask  questions;  and  use  of 
flight  time. 

Tho  total  scoro  on  tho  student’s  rating  scale  gave  tho  instructors 
with  higher  military  rank  a  reliably  better  rating  than  tho  lower 
ranking  ones.  Supervisors,  on  tho  other  hand,  tended  to  rnto  tho 
higher  ranking  instructors  ns  inferior  to  tho  lower  ranking  ones  in 
both  teaching  and  flying  proficiency.  The  differences  were,  however, 
not  statist ieaily  reliable. 

Age  oj  instructor. —  Of  tho  three  items  on  the  student’s  fating  scale 
on  which  tho  older  instructors  were  reliably  rated  better  than  tho 
younger  once,  two  dealt  with  patience  and  self-control  and  the  student' 
instructor  relationship  while  the  third  was  the  over-all  item.  They 
were:  uso  of  "chewing,”  sarcasm,  swearing,  etc.;  encouragement  to 
study  flying  outside  of  tho  airplane;  and  effectiveness  in  putting  flying 
training  across.  One  of  the  items  on  which  the  older  instructors  wero 
rated  reliably  bettor  coincided  with  one  on  which  tho  higher  ranking 
instructors  wero  also  rated  ns  reliably  better.  Tho  younger  instruc¬ 
tors  were  not  rated  reliably  better  than  tho  older  ones  on  any  of  tho 
items. 

The  total  score  on  the  student’s  rating  scale  gave  tho  older  instruc¬ 
tors  a  reliably  bettor  rating  than  the  younger  ones.  Supervisors  also 
reliably  rated  the  older  instructors  ns  hotter  than  the  younger  ones  in 
their  instructing  ability,  but  did  not  rate  the  older  group  reliably  as 
better  flyers.  This  would  indicate  that  maturity  is  a  decided  asset  to 
a  flying  instructor  but  does  not  increase  his  flying  proficiency. 

ICducalional  Iced  oj  instructor. — The  instructors  with  somo  col  logo 
education  were  rated  reliably  higher  than  those  .vho  had  not  gono 
beyond  high  school  on  two  items  of  the  student’s  rating  scale.  Ono 
of  these  items,  "conduct  ns  an  officer,”  coincided  with  ono  on  which 
the  higher  ranking  officers  were  also  rated  reliably  ns  better.  Tho 
other  item,  "ability  to  express  himself,”  is  ono  which  would  logically 
be  expected  to  be  highly  correlated  with  educational  level.  Thero 
were  no  items  on  which  tho  instructors  who  hnd  not  gono  beyond  high 
school  were  rated  reliably  ns  better  than  those  who  had. 

The  total  score  on  tho  student's  rating  scalo  gavo  tho  instructors 
with  more  than  a  high  school  education  a  reliably  hotter  rating  than 
thoso  who  hnd  not  gono  beyond  high  school.  Thero  was  no  reliable 
relationship,  however,  between  tho  education  of  tho  instructor  and 
supervisors’  ratings  of  his  teaching  or  flying  proficiency. 

Liking  oj  instructor  for  his  jo&.—Thc  instructors  who  liked  their 
assignment  as  instructors  wore  rated  reliably  as  better  than  those  who 
disliked  their  assignment  on  two  items  on  tho  student’s  rating  scale. 
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Bccm  that  tho  typo  of  behavior  which  leads  students  to  believe  that 
the  instructor  is  interested  in  his  job,  irrespective  of  whether  ho  really 
is  interested  or  not,  causes  the  students  to  givo  him  a  higher  rating  in 
teaching  proficiency. 

CONSTRUCTION  AND  VALIDATION  OF  BATTERIES  OF 
PILOT  INSTRUCTOR  SELECTION  TESTS 

The  Battery  Developed  lor  Selecting  Primary  Civilian  Instructors  90 

Tho  Civilian  Flying  Instructor  Test  (CFI  Test)  dovclopod  by 
Psychological  Research  Unit  No.  2  was  designed  as  a  teaching  apti- 
tudo  test  for  civilian  flying  instructors.  Tho  final  form  of  this  test 
(Form  B)  consisted  of  nino  subtests.  Theso  nro  described  briefly 
below. 

Test  1:  CFI  Test,  Part  I,  Angular  Judgment  {CP217A). — Sinco  field 
trips  to  primary  flying  schools  had  disclosed  that  both  instructors  and 
cadets  wero  frequently  called  upon  to  make  judgments  of  tho  magni¬ 
tudes  of  angles,  it  was  decided  to  includo  a  test  of  angular  judgment 
in  tho  Civilian  Flying  Instructor  Battery.  It  was  a  speed  test  in¬ 
volving  perception  and  judgment  of  tho  magnitude  in  degree  of  a 
visually  presented  angle.  Tho  test  consisted  of  45  items,  requiring 

W 

8  minutes  for  administration.  It  was  scored  R—f  A  samplo  item 
is  given  bolow: 

Item  5 


<«)  (6)  (c)  (d)  (e) 

170°  180°  100°  200°  210° 

Test  2:  CFI  Test,  Part  II,  Aviation  Information. — This  is  a  power 
test  measuring  knowledge  of  specific  aviation  information,  similar  to 
tho  pilot  items  of  Ccncral  Information,  CE505E,  used  in  tho  aircrow 
classification  battery.  Tho  test  consisted  of  30  items,  requiring  15 

W 

minutes  for  administration.  It  was  scored  12— A  samplo  item  is: 

Lt.  Col.  Buzz  Wagner  was  a  famous  American 

a.  fighter  pilot. 

b.  bomber  pilot. 

e.  speed  and  stunt  pilot. 

d.  test  pilot. 

e.  bombardier. 

M  Oapt*.  John  T.  DaOey,  Oleno  L.  Pinch,  tod  Richard  P.  Youli  in  primarily  responsible  tor  the  election 
tnd  development  of  thto  battery  of  tola. 
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Test  3:  CFI  Test,  Pari  III,  Complex  Mechanical  Comprehension. — 
This  was  a  power  test  consisting  of  items  selected  from  sovcrnl  .onns 
of  tho  Aviation  Cadet  Qualifying  Examination,  in  which  a  me¬ 
chanical  drawing  of  some  mechanism  was  presented  and  questions 
were  asked  about  the  functional  relation  of  parts.  Tho  test  con¬ 
sisted  of  15  items,  requiring  20  minutes  for  administration.  It  was 
W 

scored  R — £~ 

Test  4:  CFI  Test,  Part  IV,  Aviation  Vocabulary , — This  was  a  power 
test  consisting  of  original  items  on  vocabulary  terms  found  to  bo  fre¬ 
quently  used  in  describing,  explaining,  or  teaching  elementary  flight 
maneuvers.  Tho  test  consisted  of  30  items,  requiring  20  minutes 

W 

for  administration.  It  was  scored  if— -j-  A  samplo  item  is  given 
below: 

“Motion  of  an  aircraft  relative  to  the  air,  in  which  tho  lateral  axis 
is  inclined  and  tho  airplane  has  a  velocity  component  along  tho  lateral 
axis*'  is  known  as 

a.  stalling. 

b.  rolling. 

c.  sideslipping. 

d.  pitching. 

e.  yawing. 

Test  5:  CFI  Test,  Part  V,  Reading  Comprehension  on  Aviation 
Topics. — This  was  a  power  test  consisting  of  items  selected  from 
various  forms  of  tho  Aviation  Cadet  Qualifying  Examination  on  the 
basis  of  apparent  face  validity.  A  paragraph  of  technical  mate¬ 
rial  was  presented,  followed  by  a  series  of  questions  which  could 
bo  answered  from  information  presented  in  tho  paragraph.  The  test 
consisted  of  15  items,  requiring  15  minutes  for  administration.  It 

was  scored  R— 

Test  6:  CFI  Test,  Part  VI,  Pedagogical  Judgment. — This  was  a 
power  test  constructed  especially  for  this  battery.  Tho  items  aro 
based  on  an  outline  of  the  course  on  tho  Psychology  and  Technique 
of  Instruction  which  had  been  given  at  the  Central  Instructors  School 
(Primary  Pilot)  at  Randolph  Field.  Each  item  involved  an  act  of 
judgment  in  selecting  ono  of  five  altcmnto  responses  to  a  situation 
commonly  encountered  in  primary  flight  instruction.  Tho  test  con¬ 
sisted  of  15  items,  requiring  15  minutes  for  administration.  It  was 
W 

scored  R—f  A  samplo  item  is  given  below: 

Informing  a  student  how  well  ho  is  doing 

a.  is  practically  always  a  useful  technique  for  keeping  up 
motivation. 


6.  is  useful  only  with  tho  poorest  students,  if  over. 

c.  is  poor  bccauso  it  makes  satisfactory  students  overcon¬ 

fident. 

d.  is  bad  because  it  is  not  in  accord  with  Air  Corps  tradition. 

e.  will  cause  poor  students  to  become  nervous  and  good 

students  to  let  down. 

Test  7:  CFI  Test ,  Part  VII,  Biographical  Inventory. — This  consisted 
of  biographical  items  in  a  format  somewhat  similar  to  Biographical 
Data,  CE602D,  used  in  tho  aircrew  classification  battery.  Tho  test 
consisted  of  45  items,  requiring  20  minutes  for  administration.  It 
was  scored  R-  W.  A  sample  item  is  given  below: 

What  is  tho  extent  of  your  nonflying  teaching  experience  before  ° 
your  present  position? 

a.  Public  or  privato  academic  teaching. 

b.  Teaching  in  a  trade  or  vocational  school. 

c.  Teaching  or  coaching  athletics,  sports,  gym,  eto. 

d.  Teaching  use  of  machines,  etc.,  in  industry  or  teaching  soles- 

men,  clerks,  etc.,  in  business. 

e.  No  teaching  experience. 

Test  8:  Aircraft  Control  Analysis,  Form  A,  ( CI622AX1 )  and  Form 
B  (CI622AXS) . — This  test  was  developed  by  T/Sgt.  Paul  McReynolds. 

It  measured  the  ability  to  analyze  rapidly  and  accurately  the  effect 
of  aircraft  control  movements  on  the  actions  of  the  piano.  The  task 
was  to  decide  whether  each  control  position  is  correct  for  a  given 


Test  9:  Otis  Gamma  Test,  Form  AM  ( CI628A ). — A  standard  intelli¬ 
gence  test  which  was  added  to  the  buttory  as  a  possible  source  of 
additional  validity  and  for  purposes  of  intercorrclation  with  the  other 
sub-tests.  It  was  scored  Rights  only. 

Reliabilities  of  tests  of  the  battery. — Tho  Otis  Test,  the  Mechanical 
Comprehension  section  of  tho  CFI  Test,  and  tho  Reading  Compre¬ 
hension  section  of  the  CFI  Test  wero  fully  developed  tests  adopted 
without  change  and  it  was,  therefore,  deemed  unnecessary  to  com¬ 
pute  reliabilities  for  theso  tests.  Tho  investigators  believed  that  the 
various  items  in  tho  Biographical  Inventory  wero  aimed  at  such 
different  things  that  a  conventional  statement  of  tho  reliability  of 
this  inventory  would  not  bo  relevant.  Reliability  data  for  tho  other 
fivo  tests  aro  given  in  tablo  14.10.  It  can  be  seen  that  all  of  tho  tests, 
with  tho  exception  of  Pedagogical  Judgment,  have  satisfactorily  high 
reliabilities. 

Criteria  used  in  validating  tests. — After  an  investigation  of  all  avail¬ 
able  types  of  criterion  data  at  Primary  schools,  tho  threo  following 
measures  wero  used  in  validating  tho  battery  of  tests. 
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1.  Over-all  ratings  of  instructor’s  teaching  ability  by  flight  super¬ 
visors  and  squadron  supervisors.  Each  instructor  was  rated  by  his 
flight  supervisor  and  his  squadron  supervisor.  In  validating  the  tests 
the  ratings  of  tho  two  supervisors  on  each  instructor  were  averaged. 

2.  Over-all  ratings  of  instructor’s  flying  ability  by  flight  supervisors 
and  squadron  supervisors.  Each  instructor  was  rated  by  his  two 
supervisors  and  tho  two  ratings  wero  averaged  for  validation  purposes. 

Taih.k  14.10. — Reliabilities  of  tests  administered  to  cin'lian  flying  instructors 
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• 

Anpular 

JuiIr- 

meat 

Aviation 

Informa¬ 
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Aviation 
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lary 

rt506’ 
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Aircraft  control 

Form  A 

Form  B 

N  . 

734 

•0.M 

318 

•0.K) 

318 
•  0.79 

313 

•0.43 

430 
•  0.03 

i 

08 
•  aw 

Reliability . 

i  Com  pul  rd  for  Instructors  by  Hoyt  method. 

•  Odil-ovcn  reliability  corrected  by  Spcarniftn-nrown  prophecy  formula  for  unrlnsslfled  aviation  student*. 


3.  Ratings  of  instructors  by  supervisors  on  a  16-item  descriptivo 
rating  scale  developed  by  Psychological  Research  Unit  No.  2.  This 
rating  scale  has  already  been  described  on  pages  307  to  309  of 
this  chapter.  For  validation  purposes  each  scale  item  was  weighted 
1,  2,  or  3  according  to  its  median  rank  of  importance  assigned  by 
supervisors  at  the  schools  where  the  rating  scnlo  was  administered. 

Correlation  oj  tests  with  criteria. — The  product-moment  correlations 
of-  tho  9  tests  and  over-all  teaching  rating,  over-all  flying  rating,  and 
tho  16  items  of  tho  descriptive  rating  scale  arc  given  in  tablo  14.11. 

In  addition,  tctrachoric  correlations  were  calculated  between  each 
of  tho  16  items  on  the  descriptive  rating  scnlo  and  each  of  tho  9  tests 
in  the  instructor  selection  battery.  Some  items  wero  found  to  cor¬ 
relate  relatively  highly  with  the  tests.  The  multiple  correlation  of 
tho  9  tests  was  0.46  with  pilot  ability,  0.44  with  ability  to  analyzo 
errors,  and  0.43  with  ability  to  express  oneself.  The  nino  tests  had 
very  low  multiple  correlations  with  other  items,  such  os  interest  and 
conscientiousness.  Tho  multiple  correlation  of  tho  aggregate  weighted 
scoro  of  the  descriptivo  rating  scalo  with  nil  9  tests  was  0.35.  Since 
these  multiplo  correlations  were  based  on  weightings  derived  from  tho 
samo  sample,  they  would  be  expected  to  shrink  upon  repetition  and, 
in  general,  the  higher  ones  would  be  expected  to  shrink  tho  most. 

Flying  ability  was  slightly  better  predicted  by  tho  battery  of 
instructor  selection  tests  used  than  was  teaching  proficiency.  Whilo 
certain  elements  in  teaching  proficiency  seemed  to  be  measured  by 
tho  nino  tests  used  in  the  instructor  selection  battery,  other  important 
elements  wero  left  almost  completely  untouched  by  these  tests. 
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Taiji-k  14.11. — Summary  of  validities  of  the  teste  for  civilian  flying  instructors  again s 

items  in  Iks  descriptive  rating  scale 
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•  With  the  no’ptlon  of  AC  A  based  or.  313  and  Otis  on  330  itudenU. 

•  Abbreviations  refer  to  tests  In  same  vquence  as  presented  in  teat  pp.  334  through  338. 

•  Using  only  tests  with  validities  of  0.13  or  (renter.  Since  the  weights  were  based  on  this  same  sample, 
the  multiple  correlations  will  be  sul  Jcct  to  shrinkage  upon  repetition  o(  the  validation,  and  In  general,  the 
higher  correlations  will  be  eapcctcd  to  shrink  more  than  the  lower  ones. 

5 

The  Battery  of  Instructor  Selection  Test#  Administered  at  Redistribution 
Stations  to  Returned  Combat  Personnel 

Six  of  tho  battery  of  instructor  selection  tests  administered  at  re¬ 
distribution  stations  to  returned  combat  personnel  wero  weighted  for 
pilot  instructing  and  wero  known  as  tho  Pilot  Instructor  Selection 
Battery.  Thcso  tests  wero  developed  by  the  Psychological  Research 
Projects  and  other  psychological  agencies  in  tho  Air  Forces.  They 
wero  ail  tried  out  experimentally  and  refined  before  tho  final  battery 
was  constructed.  Tho  Pilot  Instructor  Selection  Battery  was  given 
to  all  returned  combat  pilots  passing  through  redistribution  stations 
during  the  period  16  November  1944  through  21  Juno  1945.  Tbo 
individual  tests  in  this  battery  aro  described  briefly  below. 

1.  Mechanical  Comprehension  Test,  DS201A. — Tliis  was  a  test  of 
tho  officer's  knowlcdgo  of  mechanical  relationships.  It  was  similar 
to  tiio  mechanical  comprehension  test  which  had  been  ono  of  tho  most 
promising  of  tho  tests  administered  to  civilian  flying  instructors. 
Mechanical  drawings  wero  presented  and  questions  wero  esked,  tho 
correct  answer  to  which  presupposed  a  knowlcdgo  of  tho  functional 
relations  of  tho  parts.  Tho  test  consisted  of  40  items.  Tho  ad- 

W 

ministration  timo  was  15  minutes.  Tho  scoring  formula  was  R — -• 

2.  Aircrew  Officer  Blank,  DEROSA. — This  was  a  survey  of  experience 
and  attitudes  which  avnilablo  ovidcnco  indicated  should  nlTcct  success 
as  nn  instructor.  Some  questions  called  for  statements  of  attitudes; 


338 


others  required  factual  information  about  past  experience.  TIjo  teat 
consisted  of  90  items.  Tho  administration  iimo  was  30  minutes. 
Tho  scoring  formula  was  R.  Two  samplo  items  aro  givon  below. 

My  preference  regarding  return  to  combat  duty  is 

a.  I  want  to  return  soon. 

b.  I  hopo  to  return  sometime. 

e.  I  don’t  care  whether  I  return  or  not. 

d.  I’d  somewhat  prefer  not  to  return. 

e.  I'd  strongly  prefer  not  to  return. 

How  easy  do  you  find  it  to  meet  and  get  acquainted  with  strangers 
when  there  is  no  one  present  to  introduce  you  and  get  tho  conversation 
going? 

a.  Very  easy  to  get  acquainted;  nothing  to  it. 

b.  Usually  no  difficulty  making  acquaintance. 
e.  About  the  averago  hesitancy  and  slowness. 

d.  Slower  and  less  successful  than  tho  average. 

e.  Very  much  slower  and  harder  than  for  tho  avornge. 

3.  Reasoning  Test,  DG601B. — This  was  a  test  of  tho  ability  to  solve 
arithmetical  problems  involving  reasoning.  Tho  test  consisted  of 
30  items,  requiring  20  minutes  for  administration.  Tho  scoring 
W 

formula  was  R — — •  A  sample  item  is  given  below. 

A  pilot  has  flown  120  hours  in  70  days.  How  many  hours  will  he 
have  to  fly  in  tho  next  ten  days  in  order  to  average  2  hours  of  flying 
time  per  day  for  the  entire  period? 

a.  20  hours. 

b.  40  hours. 
e.  70  hours. 

d.  90  hours. 

e.  120  hours. 


4.  Verbal  Comprehension  Test,  DG101B. — This  was  a  test  of  tho 
ability  to  comprehend  written  material  of  a  rather  complex  naturo.  A 
technically  written  paragraph  on  somo  subject  was  presented  and  a 
series  of  questions  were  asked  on  it.  Answering  tho  questions  cor¬ 
rectly  presupposed  a  complete  understanding  of  tho  verbally  presented 
material.  Tho  test  consisted  of  a  total  of  30  questions  on  0  para¬ 
graphs  of  material,  requiring  20  minutes  for  administration.  Tho 


W 

scoring  formula  was  R - - 


5.  Personal  Inventory,  DE201C. — This  was  an  inventory  of  informa¬ 
tion  concerning  factors  such  as  tho  officer’s  interests,  fears,  and  social 
adjustment.  It  was  aimed  at  predicting  a  number  of  qualities  con¬ 
sidered  to  bo  desirablo  in  an  instructor  and  believed  to  bo  related  to 
such  factors.  Tho  inventory  consisted  of  45  items,  requiring  10  min- 
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utes  for  administration.  The  scoring  formula  was  R.  Two  sample 
items  are  given  helow.  In  each  question  a  forced  choico  was  required 
between  two  answers — the  one  on  the  left  side  of  the  pago  and  the  ono 
on  the  right. 

a.  I  like  working  by  myself.  b.  I  liko  working  with  others. 

I  wish  I  wouldn’t  feel  so  tired,  b.  I  wish  I  could  have  a  more 

responsible  job. 

G.  /nalysis  oj  Maneuvers,  DSJfllB. — This  was  a  tost  of  an  under- 
I  t,  ’  ,g  nr  maneuvers  which  an  instructor  must  bo  ablo  to  explain 
to  h’  students.  It  was  based  on  the  assumption  that  pilots  who 
understand  the  fundamental  principles  of  flying  and  arc  ablo  to  apply 
them  to  the  analysis  of  maneuvers  will  be  more  likely  to  be  ablo  to 
explain  flying  to  the  student  and  to  analyze  his  errors.  The  test 
consisted  of  GO  true-false  items,  requiring  20  minutes  for  administra¬ 
tion.  The  scoring  formula  was  R-XV.  Two  sample  items  aro  given 
below. 

(Fab- )  If  the  nose  of  tho  airplane  moves  to  the  right  of  the  intended 
flight  path  in  executing  a  loop,  there  was  probably  insuffi¬ 
cient  correction  of  torque. 

(True)  With  altitudo  held  constant,  the  angle  of  attack  would  bo 
greater  in  a  steep  turn  at  120  m.p.h  than  in  level  flight  at  120 
m.  p.h. 

Reliability  oj  tests  oj  battery. — Tho  reliabilities  of  the  six  tests  of  the 
Pilot  Instructor  Selection  Battery  aro  presented  in  tablo  14.12.  It 
can  be  seen  that  the  reliabilities  of  nil  of  tho  tests  wero  satisfactorily 
,  h,  villi  the  exception  of  Analysis  of  Maneuvers  which  was  consid¬ 
erably  lower  than  the  others.  The  reliabilities  ranged  from  0.42  to 
0.S3. 


Tajii.k  1-1.12. — Itrlinbilitir »  and  inlercorrrlalions  of  testa  and  inventories  in  the 
pilot  instructor  selection  battery  administered  at  redistribution  stations 
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May  1915. 

•  It*  ll.iblllty  cumputed  by  Hoyt  method. 


Intercorrelations  oj  tests  oj  battery. — Intercorrelations  between  tho 
six  tests  used  in  the  Pilot  Instructor  Selection  Battery  tvero  computed 
for  a  population  of  *100  pilots  tested  between  15  January  and  1  May 
1915  at  Redistribution  Station  No.  2,  Miumi  Bench,  Fla.  Thcso  aro 
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also  presented  in  table  14.12.  It  will  bo  seen  that  the  testa  wero 
satisfactorily  independent  with  intercorrelations  ranging  from  —0.05 
to  0.50. 

Criteria  used  in  validating  the  tests. — As  already  discussed  on  pages 
302  through  300  of  this  chapter,  no  suitnblo  “in  training”  criteria 
could  bo  found  for  validating  tho  Pilot  Instructor  Selection  Battery  of 
tests.  Tho  three  following  on-the-job  criteria  wero  employed  in  tho 
validating  study: 

1.  Students'  ratings  of  instructors  secured  on  tho  18-itom  Students* 
Rating  Scale  developed  by  tho  Pilot  Project.  Tho  nverngo  total 
score  of  all  students  rating  the  same  instructor  was  used  in  tho  vali¬ 
dation  study.  An  averago  of  3.12  students  rated  each  instructor. 

2.  Supervisor’s  over-all  rating  of  tho  instructing  proficiency  of 
tho  instructor. 

3.  Supervisor’s  over-all  rating  of  tho  flying  ability  of  tho  instructor. 

Tho  two  latter  ratings  wero  on  a  3-point  scalo  (in  upper  25  percent 

of  instructors,  in  middle  50  percent  of  instructors,  or  in  lower  25  per¬ 
cent  of  instructors  in  each  school.) 

As  already  reported  on  pages  317  and  319  of  this  chapter,  correla¬ 
tions  between  these  threo  types  of  criterion  data  showed  that  there  was 
littlo  relationship  between  supervisors’  and  students’  ratings  of  instruc¬ 
tor  proficiency  (r=0.08),  or  between  supervisors’  ratings  of  flying 
ability  and  students'  ratings  of  instructor  proficiency  (r=0.06). 
There  was,  on  tho  other  hand,  a  closo  correspondence  botween  super¬ 
visors’  ratings  of  flying  ability  and  their  ratings  of  instructor  pro¬ 
ficiency  (r=0.70). 

Validation  results. — Tho  validation  results  wero  based  on  a  popu¬ 
lation  of  215  returned  combat  pilots  on  whom  validation  data  liad 
been  secured  and  on  whom  test  scores  wero  available.*1  Each  test 
of  tho  Pilot  Instructor  Selection  Battery,  tho  instructor  stanino,  an 
aggregato  scoro  bnsed  on  tho  weighted  averages  of  all  tho  tests,  and 
tho  instructor  preference  wero  validated  against  each  of  tho  threo 
criteria  mentioned  above.  Beforo  computing  tho  correlations,  tho 
students’  rating  scalo  scores  and  tho  scores  on  each  of  tho  instructor 
selection  tests  wero  normalized  and  converted  into  standard  scores 
ranging  from  1  to  0.  Tho  correlations  obtained  aro  presented  in 
tablo  14.13. 

It  will  bo  scon  that  the  correlations  range  from  —0.19  to  0.04  and 
that  tho  majority  of  them  are  negative.  The  conclusion  must  bo 
drawn  that  there  is  no  positivo  relationship  between  tho  scores  mado 
on  tho  Pilot  Instructor  Selection  Tests  and  tho  ratings  which  a 
returned  combat  pilot  will  receive  from  his  students  and  supervisors 
on  his  instructing  proficiency  and  flying  ability  while  actually  teaching 
students  in  the  field.  This  lack  of  relationship  may  bo  due  to  either 

•«  Ratings  vm  secured  on  ■  total  of  I.JRI  Instructors  of  whom  40J  wrre  coinlut  returnee*.  I  ill  only  III 
of  theso  were  In  the  group  of  pilots  who  took  th#  Instructor  selection  tests  at  the  redistribution  Stations. 
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Taulk  14.13. — Validitiet  oj  pilot  instructor  selection  testa  administered  at  redistri¬ 
bution  stations 
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(1)  nn  inability  of  the  tests  to  separate  tho  men  who  will  mako  good 
instructors  from  the  men  who  will  not,  or  (2)  the  inadequacy  of 
ratings  of  students  and  supervisors  to  determine  tho  ability  of  an 
instructor.  Tt  cannot  be  said  with  any  degree  of  certainty  which  one 
of  these  id:  in.  tivos  may  have  produced  these  low  validities.  Tho 
reliability  of  each  of  tho  tests  of  tho  instructor  selection  battery  is 
relatively  high.  Five  of  tho  6  tests  havo  a  reliability  above  0.70, 
the  other  one  a  reliability  of  0.42.  Tho  more  rigorous  test  of  tho 
reliability  of  tho  student’s  rating  scale  (i.  o.,  correlation  between 
ratings  made  by  two  different  classes)  yields  a  coefficient  of  0.36. 
The  reliability  of  both  tho  tests  and  the  student's  rating  scale  is 
therefore  high  enough  to  allow  a  significant  correlation  to  bo  obtained 
if  a  relationship  existed.  Furthermore,  tho  scores  on  both  the 
student’s  and  the  supervisor's  rating  scales  do  correlate  significantly 
with  such  factors  ns  ago  and  educational  background  of  tho  instructor 
which  would  logically  bo  expected  to  bo  associated  with  his  ability 
as  a  teacher. 

Attempt  to  explain  negative  correlations. — In  general,  tho  correlations 
between  the  Pilot  Instructor  Selection  Tests  and  both  types  of  ratings 
were  negative;  the  correlation  between  instructor  stanino  and  super¬ 
visors’  ratings  was  —0.18,  a  correlation  of  a  sizo  which  wrould  bo 
expected  to  occur  by  chanco  only  2  times  in  100.  Sinco  it  seemed 
extremely  unlikely  that  tho  true  relationship  between  tho  super¬ 
visors’  ratings  and  general  intelligence  and  the  other  factors  measured 
by  the  instructor  selection  tests  would  actually  bo  negativo,  an  attempt 
was  made  to  locato  sources  of  constant  error  which  might  havo  biased 
the  correlation  in  a  negative  direction  and  obscured  a  positive  relation¬ 
ship,  if  one  existed. 

The  most  reasonable  hypotheses  which  could  be  mado  concerning 
such  factors  were  as  follows:  (a)  That  tho  first  returnees  selected  as 
instructors  at  tho  redistribution  stations  wero  not  selected  on  the 
basis  of  their  test  scores  but  that  tho  later  ones  wero  somewhat 
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selected  for  instructor  jobs  on  this  basis.  This  would  mean  that  tho 
average  instructor  stanma  of  tho  later  group  would  bo  somewhat 
higher  than  that  of  the  earlier  one;  (b)  that  the  first  returnees  sent 
out  by  redistribution  stations  were  given  teaching  assignments  sooner 
than  the  later  ones.  This  would  mean  that  tho  later  group  would 
have  been  instructing  for  a  shorter  period  than  tho  earlier  one;  (c) 
that  the  returnees  who  had  been  instructing  for  a  shorter  period  wero 
given  lower  ratings  by  their  supervisors.  Sinco  they  would  also  bo 
the  ones  who  were  selected  on  tho  basis  of  their  instructor  stanincs, 
such  a  factor  would  tend  to  produco  a  negativo  correlation  between 
supervisors’  ratings  and  instructor  stanincs. 

In  order  to  test  these  hypotheses,  correlations  wero  computed  be¬ 
tween  the  following:  (1)  Instructor  stnnino  and  dato  of  arrival  at 
redistribution  station;  (2)  instructor  stnnino  and  total  months  of 
instructing;  (3)  supervisors’  ratings  of  teaching  proficiency  and  dato 
of  arrival  at  redistribution  stations;  (4)  supervisors’  rating  of  teaching 
proficiency  and  total  months  instructing;  (5)  dato  of  arrival  at  redis¬ 
tribution  stations  and  total  months  instructing.  Theso  correlations 
aro  presented  in  table  14.14. 


Tablk  14.14. — Inlcreorrclations  among  instructor  stnninc,  supervisors ’  rating,  dais 
of  arrival  at  redistribution  station,  and  total  number  of  months  instructing 
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On  the  basis  of  these  correlations  it  was  possiblo  to  partial  out  the 
effect  of  dato  of  arrival  of  tho  returnees  at  tho  redistribution  stations 
from  tho  correlation  between  supervisors’  ratings  and  instructor 
stnnino:  It  was  also  possiblo  to  partial  out  tho  effect  of  tho  total 
number  of  months  of  instructor  experience.  Finally  a  scmipartial 
correlation  was  calculated  to  eliminate  tho  effect  of  date  of  urrival 
at  the  redistribution  stations  from  the  instructor  stnnino,  and  number 
of  months  of  instructor  experience  from  tho  supervisors’  ratings  of 
instructor  proficiency.  None  of  these  procedures  affected  tho  correla¬ 
tion  between  instructor  stnnino  and  supervisors’  ratings.  Therefore, 
tho  factors  which  were  outlined  above  could  not  have  produced  this 
nogntivo  correlation  or  have  obscured  a  positivo  relationship,  if  one 
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existed.  All  of  the  other  variables  on  which  data  were  available  were 
considered,  hut  it  did  not  seem  likely  that  any  of  them  could  have 
produced  a  spurious  negative  relationship. 

Possible  Reasons  for  Different  Validities  of  Selection  Batteries  Adminis¬ 
tered  to  Civilian  and  Pilot  Returnee  Instructors 

Better  validity  was  secured  on  tho  tests  administered  to  civilian 
fi  ing  instructors  than  thoso  administered  to  pilot  returnees  at  redis- 
f  i  1  *t ion  stations.  Since  somo  of  tho  tests  in  tho  two  batteries  (par¬ 
ti'  '  rly  tho  ones  involving  mechanical  and  verbal  comprehension) 
were  highly  similar  and  since  tho  batteries  wero  valid  for  ono  popula¬ 
tion  and  not  for  tho  other,  it  seemed  desirable  to  look  for  factors 
which  might  account  for  these  different  results.  Some  of  tho  more 
likely  possibilities  aro  listed  below: 

1.  Much  wider  range  of  ability  in  civilian  instructor  population. — 
Tho  civilian  flying  instructors  were  tested  immediately  after  tho 
rapid  expansion  of  tho  flying  training  program.  At  tho  beginning 
of  tho  expansion,  it  was  possible  for  tho  contractors  to  secure  a  group 
of  o<  ilian  instructors  with  very  high  professional  standards.  Toward 
the  end  of  the  expansion,  tho  need  was  so  great  and  tho  supply  so 
limited  that  tho  contractors  wero  forced  to  employ  a  considerable 
number  of  instructors  who  barely  met  tho  lowest  standards  of  flyir.g 
ability,  educational  background,  and  general  intelligence.  At  the 
time  the  civilian  instructors  wero  tested,  thoro  was  a  very  wido  range 
in  their  ability.*1 

Tho  pilot  rcturnco  population,  on  tho  other  hand,  represented  a 
highly  selected,  homogeneous  group.  Thoso  with  tho  lower  intelli¬ 
gence  and  poorer  educational  background  had  been  weeded  out  by 
tho  Army  Air  Forces  qualifying  examination.  A  further  selection, 
emphasizing  factors  related  to  pilot  ability,  was  effected  by  the 
classification  tests  and  by  elimination  in  training.  Thoso  who  sur¬ 
vived  theso  hurdles  wero  highly  selected  and  made  up  a  relatively 
homogeneous  group.  It  would,  therefore,  bo  easier  for  tho  tests  to 
differentiate  among  tho  civilian  instructors  with  a  wido  rango  of 
ability  than  among  the  moro  highly  selected  rcturnco  group. 

2.  Conditions  in  the  schools  at  the  time  validating  data  were  collected. — 
Tho  date  for  validating  tho  battery  of  civilian  flying  instructor  tests 
were  collected  during  Into  1943  and  1944  when  tho  schools  wero  run¬ 
ning  at  full  capacity  and  when  tho  instructor  and  supervisory  per¬ 
sonnel  at  tho  schools  were  relatively  stable.  Data  for  validating 
tho  pilot  instructor  selection  battery  administered  at  redistribution 
stations  was  collected  in  tho  fall  of  1945  when  many  of  tho  schools 
wore  being  closed  and  when  there  was  a  constant  tumovoi’in  instructor 
nod  supervisory  personnel.  One  would  expect  that  moro  valid  ratings 

H  With  th<*  tnl'ilng  of  more  linpoetori  It  wm  '(ihv.jnenlly  pov-Uhlc  to  eliminate  the  poor  ones  Mid  regiOn 
the  wlylnslly  higher  itunhirli, 


would  be  obtained  in  the  former  cnsc  where  supervisors  observed 
the  performance  of  their  instructors  for  longer  periods  of  timo  under 
moro  stable  conditions. 

3.  Motivational  f actors . — The  civilian  flying  instructors  to  whom 
the  battery  of  tests  was  given  were  on  the  whole  highly  motivated. 
The  jobs  for  which  they  were  held  were  interesting  and  well  paid 
and,  in  addition,  guaranteed  temporary  protection  against  their 
induction  into  the  armed  forces.  Since  they  were  all  probably  highly 
moti\ntcd,  any  differences  in  performance  were  largely  dependent 
upon  differences  in  ability.  Interviews  indicated  that  many  of  the 
returned  combat  pilots  were,  on  the  otner  hand,  not  interested  in 
an  instructor  assignment.  Since  the  returnee  pilots  varied  consid¬ 
erably  in  their  motivation  and  were  all  of  relatively  good  aptitudo, 
it  seems  likely  that  differences  in  motivation  were  an  important 
factor  in  producing  differences  in  performance.  But  it  is  difficult 
to  measure  differences  in  motivation  by  a  battery  of  instructor  selec¬ 
tion  tests.  Furthermore,  the  returnees  were  tested  at  tho  redistri¬ 
bution  station  and,  as  has  already  been  shown,  their  interest  in  tho 
job  of  instructing  changed  quite  a  bit  by  the  time  they  had  arrived 
at  the  flying  schools  and  found  out  more  about  their  assignment. 
Since  the  civilian  instructors  were  given  the  tests  after  they  had  been 
teaching  at  the  schools,  these  tests  were  moro  likely  to  reflect  their 
motivation  at  that  time.  Thus,  differences  in  motivation  would  bo 
moro  of  a  disturbing  factor  in  the  validation  of  tests  on  returnees 
than  in  the  validation  of  tests  on  civilian  instructors. 

Discussion  of  Validation  Results  Secured  on  Bombardier,  Navigator,  and 
Pilot  Populations 

Psychological  Research  Project  (Navigator)  has  reported  that 
none  of  the  Navigator  Instructor  Selection  Tests  investigated  had 
moro  tlinn  a  chance  relationship  with  on-the-job  criteria  of  instrutor 
proficiency.®1  Tho  tests  investigated  were  Survey  of  Attitudes  and 
Scientific  Background,  and  the  weighted  combined-score  on  theso 
two  tests.  The  on-the-job  criteria  used  were  ratings  by  students, 
fellow  instructors,  flight  commanders,  supervisors,  ami  by  tho 
instructor  himself.  The  correlation  between  tho  tests  and  tho 
criterion  data  ranged  from  —0.18  to  0.11,  with  the  majority  of  them 
being  positive  but  very  low. 

Psychological  Research  Project  (Bombardier)  used  supervisors' 
and  students'  ratings  of  instructor  proficiency  ns  on-the-job  criteria 

••  In  addition  to  securing  on-the-job  criteria  of  Instructor  proficiency,  tho  Navigator  and  Bombardier 
Projects  a  bo  collected  considerable  criterion  data  on  returnee  Instructors  while  they  wrre  receiving  their 
training  at  the  Instructor  training  schools.  In  tha  bombardier  schools  the  Instructor  selection  tests  wero 
validated  against  criterion  <Liui  which  wrre  fairly  heavily  weighted  w  ph  ground*  heel  nwlcs'  v«d  on  written 
tests.  Rather  high  correlations  were  round  In  Ihe  bombardier  schools  between  such  criteria  and  tha 
Instructor  stanlne  and  some  of  the  Individual  Instructor  selection  tests.  The  Pilot  Project  did  not  attempt 
to  validate  tha  tests  against  criteria  secured  at  Ihe  Pilot  Central  Instructors  {Schools  time  both  rllratnstka 
policy  and  proficiency  records  at  these  schools  were  for  the  most  part  based  solely  on  Ihr  student's  flying 
ability  and  did  not  reflect  his  Instructing  proficiency. 
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for  validating  tho  Bombardier  Instructor  Selection  Tests.  The 
correlations  between  tho  individual  tests  and  tho  criterion  data 
ranged  from  0.11  to  0.43.  In  general,  tho  correlations  were  fairly 
substantial,  the  students’  ratings  tending  to  correlate  moro  highly 
with  the  tests  than  the  supervisors'  ratings. 

Some  of  the  factors  which  aro  thought  to  bo  responsible  for  the  defi¬ 
nitely  better  validation  results  secured  on  tho  Bombardier  and  the 
pov  ibly  better  results  secured  on  tho  Navigator  battery  of  instructor 
sole*.  tion  tests  in  comparison  with  thoso  secured  on  tho  Pilot  battery 
arc  discussed  briefly  below: 

1.  Instructor  tasks  may  be  different  for  the  different  types  oj  instruc¬ 
tors. — Since  four  of  the  tests  (Arithmetic  Reasoning,  Mechanical  Com¬ 
prehension,  Personal  Inventory,  and  Verbal  Comprehension)  were 
identical  for  the  Bombardier  and  Pilot  batteries  and  since  statistically 
significant  validities  wero  obtained  for  these  tests  on  a  bombardier 
returnee  population  and  not  on  a  pilot  returnee  population,  tho  differ¬ 
ences  in  validation  results  could  not  havo  been  produced  by  differences 
in  the  tests.  They  must  havo  resulted  cither  from  tho  fact  that  the 
abilities  measured  by  tho  tests  wero  important  in  tho  instructor  per¬ 
formance  of  bombardiers  but  not  important  in  tho  instructor  perform¬ 
ance  of  pilots,  or  from  other  factors. 

2.  Criterion  ratings  may  hare  been  better  for  bombardiers  and  naviga¬ 
tors  than  for  pilots. — Tho  samo  two  types  of  ratings  (ratings  by  stu¬ 
dents  and  ratings  by  supervisory  personnel)  were  used  in  validating 
tho  tests  on  nil  three  types  of  instructors.  These  two  types  of  ratings 
correlated  highest  for  bombardier  instructors  (r=0.57),  next  for  navi¬ 
gator  instructors  (r=0.27)  and  lowest  for  pilot  instructors  (r=0.08). 
This  may  be  partly  duo  to  tho  fact  that  supervisors  have  more  oppor¬ 
tunity  to  oh  ervo  tho  performance  of  bombardier  and  navigator 
instructors  since  their  instruction  always  takes  place  in  multicngine 
planes  where  there  is  spneo  for  an  observer.  Furthermore,  tho  unit 
commander  in  navigator  schools  w*as  much  better  able  to  observe  the 
instructors  under  him  because  so  much  instructing  was  done  on  tho 
ground.  It  may  also  bo  partly  duo  to  tho  fact  that  it  is  easier  for 
supervisors  to  observe  the  typo  of  teaching  procedure  which  charac¬ 
terizes  good  and  poor  bombardier  and  navigator  instructors.  Due 
to  tho  fact  that  supervisors  do  not  have  much  opportunity  to  observo 
pilot  instructors  in  a  teaching  situation,  and  the  difficulty  of  making 
valid  observations  ns  to  what  constitutes  good  and  poor  techniques 
of  instructing,  supervisors  baso  their  cstimato  of  the  teaching  profi¬ 
ciency  of  tho  pilot  instructor  almost  entirely  on  v  hat  they  can  easily 
observe,  namely,  his  flying  ability.  A  correlation  of  0.70  was  found 
between  these  two  ratings  by  tho  Pilot  Project.  No  single  factor 
seems  to  havo  such  influence  in  determining  tho  ratings  of  teaching 
proficiency  given  to  bombardier  and  navigator  instructors  by  their 
supervisors. 
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3.  llangc  oj  ability  'probably  more  restricted  in  pilot  and  navigator 
returnee  populations.— During  the  first  part  of  the  war,  tho  effect  of 
the  classification  procedures  was  to  send  the  student  with  lower 
general  aptitudes  to  bombardier  training.  Two  factors  tended  to 
lower  the  quality  of  tho  bombardier  students:  tho  elimination  policies, 
and  tho  preference,  of  most  cadets,  for  pilot  training.  Therefore, 
the  pilots  and  navigators  would  be  expected  to  be  tho  most  select 
groups,  while  the  bombardiers  should  contain  numbers  of  men  with 
considerably  lower  ability.  This  possibly  wider  rango  of  ability 
among  bombardiers,  particularly  at  tho  low  end  of  the  distribution, 
may  have  been  ono  of  tho  reasons  why  tho  bombardier  instructor 
selection  tests  proved  to  bo  tho  most  effective. 

SUMMARY  OF  RESULTS  AND  RECOMMENDATIONS  FOR 

FUTURE  WORK 

Main  Areas  of  Work  and  Chief  Results 

Since  tho  flying  instructor  occupied  a  key  position  in  tho  pilot¬ 
training  program,  a  considerable  amount  of  work  was  devoted  to  tho 
development  of  procedures  for  evaluating  and  selecting  flying  in¬ 
structors.  Tho  areas  which  this  research  covered  and  tho  chief  results 
may  bo  summarized  as  follow: 

Job  analysis. — Studies  in  this  area  delineated  fivo  attributes  which 
supervisors,  instructors,  and  students  at  all  levels  of  training  con¬ 
sidered  most  important  for  tho  good  flying  instructor.  Theso  wero: 
paticnco  and  self-control,  ability  to  adapt  teaching  methods  to  indi¬ 
vidual  students,  flying  ability,  analysis  of  errors,  and  ability  to 
express  himself. 

Development  of  supervisor’s  and  student's  rating  scales. — Two  rating 
scales,  based  on  tho  qualities  which  tho  job  am. lysis  studios  had 
shown  were  important,  were  constructed  and  refined.  Ono  of  theso 
was  a  16-item  scale  for  tho  rating  of  flying  instructors  by  supervisors. 
Tho  correlation  between  ratings  by  supervisors  and  assistant  super¬ 
visors  was  0.C5.  This  is  an  estimate  of  maximum  reliability  sinco 
these  two  raters  had  probably  influenced  each  other  s  opinion  of  tho 
instructor.  The  intcrcorrelations  of  tho  items  of  tho  scale  ranged 
from  0.26  to  0.90,  with  tho  majority  of  them  rather  high.  This 
indicated  tho  presence  of  a  “halo”  effect  in  tho  ratings  as  well  as  a 
possibly  closo  relationship  among  the  factors  measured  by  tho  items. 

Tho  other  scale  consisted  of  18  items  and  was  for  tho  rating  of 
flying  instructors  by  their  students.  When  each  instructor's  students 
in  a  given  class  wero  divided  into  two  halves  and  tho  ratings  of  theso 
two  groups  wero  correlated  with  each  other,  tho  cstimato  of  split- 
group  reliability  corrected  for  full  number  was  0.75.  Correlating  tho 
averago  of  tho  ratings  by  students  in  ono  class  with  that  of  students 
in  a  different  class  at  least  5  weeks  later,  yielded  a  test-retest  reliability 
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of  0.3G.  Both  of  those  figures  fire  based  on  an  average  of  3.25  students 
per  class  for  each  instructor.  The  marked  reduction  in  the  size  of  the 
correlation  when  the  students  came  from  two  different  classes  was 
probably  caused  by  removing  the  opportunity  for  tho  students  in  the 
different  groups  to  influence  each  other.  It  is  also  possible  that  the 
instructors  changed  somewhat  during  tho  period  of  five  or  moro  weeks 
b  tween  the  two  ratings. 

One  of  the  13  items  on  the  scale  was  an  over-all  rating.  On  dif- 
fei  nt  classes  the  tcst-rctest  reliability  of  this  item  was  0.23.  The 
fact  'hat  the  reliability  of  the  total  score  was  definitely  higher  (r=0.36, 
difference  significant  above  the  1  percent  level)  than  the  single  over-all 
item,  indicated  the  value  of  rating  different  aspects  of  performance 
separately  and  then  totaling  these  ratings. 

These  results  were  secured  at  Advanced  and  Transition  schools. 
The  split-group  reliability  at  the  basic  level  of  training  was  approxi¬ 
mately  the  same,  but  the  reliability  of  ratings  at  tho  primary  level, 
where  the  students  were  relatively  inexperienced,  was  lower. 

The  intcrcorrelations  among  the  items  of  the  scale  ranged  from  0.12 
to  0.7G,  with  the  majority  of  them  below  0.40.  This  indicates  that,  in 
spite  of  "halo"  effects  and  similarities  among  the  different  attributes 
rated,  the  various  items  in  the  scale  arc  independent  enough  to  be 
useful. 

Development  and  validation  oj  instructor  selection  tests. — On  tho  basis 
of  interviews,  check  lists,  students’  and  supervisors’  opinions,  and 
other  information  gained  in  the  job  analysis  studies  of  tho  factors 
related  to  instructor  success,  experimental  instructor  selection  tests 
were  constructed.  One  battery  of  these  tests  was  administered  to 
civilian  primary  flying  instructors  while  instructing  nt  a  primniy 
flying  school  subsequent  to  their  instructor  training.  This  battery 
was  validated  against  the  16-item  supervisor’s  rating  scale.  The 
multiple  correlation  of  the  aggregate  weighted  score  of  tho  16-item 
scale  with  the  battery  of  9  tests  was  0.35.  Flying  ability  was  slightly 
better  predicted  by  the  tests  than  wns  instructing  proficiency.  Vali¬ 
dation  against  the  separate  items  of  the  rating  scale  showed  that  some 
of  them  were  measured  by  this  bnttory  of  instructor  selection  tests 
while  others  were  not. 

The  other  battery  of  tests  was  administered  at  redistribution  sta¬ 
tions  to  returned  combat  pilots,  some  of  whom  later  became  instruc¬ 
tors.  This  battery  was  validated  agninst  the  18-item  student’s  rating 
scale  and  against  supervisor’s  over-all  rating  of  instructing  proficiency 
and  flying  ability.  There  wns  no  significant  relationship  between 
performance  on  any  of  the  instructor  selection  tests  in  this  battery 
and  subsequent  ratings  which  the  flying  instructor  received  from  his 
students  or  his  supervisors  while  teaching  at  Advanced  and  Transition 
schools. 

Ilclationship  oj  biographical  factors  to  successful  teaching. — Items  of 
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biographical  and  personal  data  were  secured  on  1,284  flying  instruc¬ 
tors  and  related  to  the  average  rating  which  these  instructors  received 
from  students  and  supervisors. 

It  was  found  that  preference  expressed  at  a  redistribution  station 
did  not  predict  how  well  an  instructor  would  like  instructing  after 
ho  arrived  at  a  pilot  school  and  started  to  teach.  Onco  ho  was  on 
the  job,  however,  the  instructor’s  like  or  dislike  for  his  assignment 
was  quite  stable  from  class  to  class. 

The  older  flying  instructors  received  reliably  higher  ratings  as 
teachers  than  the  younger  ones  from  both  their  students  and  their 
supervisors.  The  instructors  with  more  education  and  thoso  with  a 
higher  military  rank  were  also  rated  as  reliably  better  by  their  stu¬ 
dents,  but  were  not  rated  as  bettor  instructors  by  their  supervisors. 
Students  gave  combat  returnees  better  ratings  as  instructors  than 
nonreturnccs,  but  supervisors  gavo  the  noureturnco  the  better  rating 
in  both  teaching  and  flying.  Instructors  who  liked  their  assignment 
were  rated  as  better  instructors  by  their  supervisors  but  not  by  their 
students. 

The  relationship  of  length  of  experience  as  a  flying  instructor  to 
supervisors’  ratings  of  teaching  was  curvilinear;  tho  ratings  became 
higher  with  more  experience  up  to  two  years  but  wero  somewhat 
lower  beyond  that  point.  The  total  scoro  on  the  student’s  rating 
scalo  showed  no  statistically  reliablo  difference  for  instructors  with 
different  amounts  of  experience.  However,  an  analysis  for  each  of 
the  items  of  this  scale  showed  that  tho  instructors  who  had  taught 
flying  for  longer  poriods  of  time  received  roliubly  higher  ratings  on 
technical  aspects  of  teaching  ability,  such  ns  analysis  of  errors  and 
ability  to  express  themselves,  and  reliably  lower  ratings  on  personality 
items,  such  as  interest  in  the  student  and  patience  and  self-control. 
Apparently,  longer  periods  of  tenching  flying  improved  tho  instruc¬ 
tor’s  technical  ability  but  spoiled  his  patience  and  personality. 

Recommendations  for  Future  Work 

Introduction  oj  i)radicc  teaching  in  central  instructors  schools. — 
Teaching  cannot  bo  learned  by  lectures  and  demonstrations  alone, 
without  supervised  practice,  any  more  than  flying  can.  If  Central 
Instructors  Schools  arc  going  to  emphnsizo  teacher  training  in  addi¬ 
tion  to  standardized  flying,  it  will  bo  necessary  for  them  to  have  an 
experimental  school  in  which  tho  student-instructor  can  practice 
teaching  cadets  under  expert  supervision.  Such  a  procedure  will  bo 
less  unfair  to  tho  cadets  involved  than  it  would  bo  for  them  to  bo  in 
tho  first  class  taught  by  the  same  instructor  in  an  ordinary  school 
without  special  supervision.  In  two-engino  planes  tho  supervisor 
can  ride  from  time  to  time  with  tho  instructor  and  his  student;  in 
single-engine  planes  magnetic  wire  sound-recorders  and  air-to-ground 
radios  may  bo  used  to  samplo  tho  performance.  Lectures  and  dis- 
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(Missions  will  bo  much  moro  meaningful  to  student-instructors  after 
they  have  had  somo  experience  in  practice  teaching.  The  practioe- 
teach'  ig  school  will  also  tend  to  keep  tho  stall  instructors  in  closer 
touch  with  tho  problems  of  cadet  training. 

Research  should  be  devoted  to  developing  special  techniques  for 
grading  the  student  on  his  practice  teaching  so  that  eliminations  from 
central  instructors  schools  may  be  based  on  teaching  as  well  as  flying 
ability.  Grades  on  teaching  ability  at  the  Central  Instructors  School 
should  be  validated  against  subsequent  performance  in  tho  pilot  train* 
ing  schools  to  which  the  instructors  arc  assigned. 

Measurement  of  teaching  'proficiency  at  pilot  schools. — Tho  18-item 
student  rating  scale  should  be  refined  and  shortened  somewhat.  On 
the  basis  of  data  collected  as  part  of  tho  validation  of  instructor  selec¬ 
tion  tests,  tho  test-retest  reliability  of  each  item,  when  the  same 
instructors  are  rated  by  different  classes,  should  be  determined.  In 
tho  light  of  these  reliabilities  and  tho  intercorrelations  presented  in 
this  chapter,  the  items  which  arc  least  reliable  and  least  independent 
should  be  eliminated. 

The  16-item  descriptive  scale  developed  for  supervisors  to  rate 
civilian  instructors  should  also  be  refined  and  adapted  for  uso  at  all 
levels  of  military  flying  instruction.  In  order  to  mako  any  funda¬ 
mental  improvements  in  tho  supervisors’  ratings  of  instructor  profi¬ 
ciency,  however,  it  will  probably  bo  necessary  to  mako  systematic 
attempts  to  seo  that  he  gets  a  better  opportunity  to  observe  his  instruc¬ 
tors  in  the  actual  teaching  situation.  In  the  reduced  peacetime  train¬ 
ing  program,  it  should  bo  possiblo  for  tw'o-cngino  supervisors  to  ride 
with  their  instructors  and  students  moro  frequently  and  for  singlo- 
engine  supervisors  to  sample  instruction  by  techniques  such  as  air-to- 
ground  radio  or  magnetic  w’iro  recorders. 

noth  the  student  and  tho  supervisor  rating  scales  should  bo  used  to 
allow  the  instructors  to  sec  themselves  as  others  seo  them.  It  is 
believed  that  it  would  be  highly  dcsirablo  to  try  using  tho  present 
form  of  the  student  rating  scale  for  this  purpose. 

Since  tho  ultimate  test  of  the  instructor  is  tho  quality  of  the  stu¬ 
dents  which  lie  produces,  it  would  bo  highly  dcsirablo  to  validate  and 
item-analy/.c  both  the  student  and  the  supervisor  rating  scales  against 
the  quality  of  students  produced  by  the  instructor  under  controlled 
conditions.  Tho  flying  aptitude  of  students  assigned  to  different 
instructors  should  be  equalized  on  the  basis  of  pilot  stanincs  in  pri¬ 
mary  schools  and  on  the  basis  of  stanincs  nnd  preceding  flying  grades 
in  other  schools.  Transfer  of  students  from  ono  instructor  to  another 
should  be  minimized,  nnd  where  transfer  is  absolutely  necessary,  the 
student  should  be  dropped  from  the  study.  Special  attention  should 
bo  paid  to  securing  tho  best  possiblo  measuro  of  tho  student’s  profi¬ 
ciency.  In  addition  to  providing  a  basis  for  improving  the  scales, 
determining  tho  items  which  best  discriminate  between  instructors 
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producing  good  and  poor  students  would  be  a  fundamental  contribu¬ 
tion  to  the  job  analysis  of  the  qualities  most  important  for  the  good 
flying  instructor. 

Improved  student  and  supervisor  rating  scales  would  bo  useful:  (l) 
In  improving  instructors  on  the  job  by  letting  them  know  their  wenk 
points;  (2)  in  validating  instructor  selection  tests,  and  Central  In¬ 
structors  School  grades;  (3)  in  studying  the  way  in  which  factors, 
such  as  length  cr  signmont  as  an  instructor  and  other  biographical 
data,  arc  related  teaching  proficiency;  and  (4)  in  measuring  tho 
results  of  training  experiments  conducted  to  cvalunto  tho  effect  of 
procedures,  such  as  adding  variety  to  the  life  of  the  flying  instructor 
by  temporarily  rotating  him  to  other  assignments. 

Attempt  to  predict  teaching  success. — Further  effort  should  be  devoted 
to  the  difficult  problem  of  trying  to  develop  and  validate  a  battery  of 
tests  and  inventories  for  selecting  those  pilots  who  arc  most  likely  to 
become  successful  flying  instructors.  Such  tests  should  bo  developed, 
not  only  for  their  possiblo  usefulness  in  the  peacetime  program,  but 
also  as  an  important  technique  to  have  in  reserve  to  deal  with  any 
future  need  for  rapid  emergency  expansion. 
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CHAPTER  FIFTEEN 


Summary  of  Main  Results  and 
Recommendations  for 
Future  Work 

Maj.  Neal  E.  Miller  * 


This  chapter  summarizes  the  main  results  of  psychological  research 
on  pilot  training  during  the  second  World  War  and  presents  tho  chief 
recommendations  for  further  work.  More  detailed  summaries  and 
recommendations  have  already  been  presented  at  the  end  of  each  of 
tho  preceding  chapters. 

The  opportunity  for  psychological  research  on  pilot  training  de¬ 
veloped  gradually  out  of  the  original  work  on  pilot  aptitude  tests  by 
aviation  psychologists.  On  1  February  1944  an  organization  ro- 
sponsiblo  for  research  on  pilot  training,  the  Psychological  Research 
Project  (Pilot),  was  established  at  Randolph  Field,  Tex.  Tho  work 
started  slowly,  but  as  the  psychologists  learned  more  about  flying 
and  the  pilots  responsible  for  training  discovered  tho  usefulness  of  tho 
scientific  techniques  employed  by  the  psychologists,  research  continued 
fo  develop  at  an  accelerated  pace. 

Tho  areas  of  research  were  determined  by  directives  from  higher 
headquarters.  Tho  two  main  areas  were:  To  develop  objective 
measures  of  flying  skill,  and  to  develop  techniques  for  the  evaluation 
and  selection  of  flying  instructors.  Certain  other  types  of  work  were 
also  carried  forward.  An  analysis  of  tho  job  of  the  student  pilot  was 
made  in  order  to  provide  a  basis  for  developing  objective  measures  of 
flying  skill  and  for  improving  pilot  aptitude  tests.  Subjective  meas¬ 
ures  of  flying  skill  and  fixed  gunnery  scores  were  evaluated  as  possiblo 
criteria  for  validating  the  pilot  aptitude  tests  and  as  supplements  to 
the  objective  measures  of  flying  skill.  Sinco  the  combat  pilot  had 
to  possess  factual  information  as  well  as  flying  skill,  printed  tests  of 
flying  information  were  developed  to  test  types  of  knowledge  which 
could  be  measured  more  efficiently  on  tho  ground  than  in  tho  air. 
The  pressure  of  work  which  was  directed  by  higher  headquarters  and 
was  more  closely  related  to  tho  classification  program,  prevented  tho 
amount  of  attention  being  devoted  to  training  experiments  which 
this  type  of  work  is  believed  to  merit.  Two  minor  studies  were  con¬ 
ducted  which  illustrate  the  types  of  issues  that  can  profitably  be 
decided  by  the  experimental  method. 
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The  following  sections  present  the  main  results  and  the  suggestions 
for  future  work  in  each  of  these  areas. 

ANALYSIS  OF  TIIE  PILOT’S  TASK 

Military  flying  training  is  different  from  civilian  in  that  it  is  con¬ 
duct  d  under  greater  pressure  and  requires  more  precision,  but  the 
basic  principles. arc  much  tho  same. 

(  o  tain  characteristics  which  make  the  task  of  flying  more  difficult 
th  m  l’ nit  of  driving  a  car  are  determined  by  ways  in  which  tho  air 
differs  from  the  ground.  A  car  is  steered  to  the  left  or  right  on  tho 
surface  of  tho  ground.  An  airplane  is  steered  in  two  additional 
ways:  besides  steering  to  the  left  or  right  in  the  air,  the  pilot  must 
raise  and  lower  the  nose  of  his  airplane  and  control  the  tilt  of  its 
wings.  Because  of  tho  various  ways  in  which  these  three  types  of 
movement  interact,  they  more  than  triple  the  complexity  of  the  task. 
For  example,  in  making  turns  the  stick  and  rudder  must  be  used 
together  properly.  If  too  great  pressure  is  applied  to  the  stick,  tho 
airplane  \n ill  tend  to  slip;  if  too  much  is  applied  to  tho  rudder  it  will 
tend  to  skid.  Because  the  lift  of  tho  wings  is  reduced  when  they 
are  banked  in  a  turn,  the  back  pressure  on  the  stick  must  also  bo 
increased.  To  cite  another  example,  whenever  the  nose  of  a  single- 
engino  airplane  is  pointed  up,  a  tendency  for  it  to  swerve  to  tho  left 
must  be  corrected  by  pressure  on  the  right  rudder,  and  if  air  speed 
is  to  be  maintained,  the  throttle  must  also  be  advanced  to  increase 
the  power. 

The  control  movements  for  theso  three  types  of  steering  arc  rcla-  , 
tivoly  simple,  much  like  those  of  driving  a  car.  A  largo  part  of  tho 
increased  complexity  is  perceptual,  keeping  track  of  tho  courso  of 
the  airplane  over  the  ground,  of  the  attitude  of  tho  nose  and  wings, 
and  sensing  a  lack  of  balance,  or  tendency  for  the  body  to  sway  to 
one  side,  if  stick  and  rudder  arc  not  properly  coordinated  when  rolling 
into  turns. 

Tho  fact  that  the  air  is  transparent  and  is  without  any  rcfcrcnco 
points  makes  difficult  the  planning  of  a  three-dimensional  courso 
through  it  and  places  a  premium  on  visualization  of  sputial  relation¬ 
ships.  For  example,  in  a  forced  landing  the  student  must  allow  for 
the  amount  of  altitude  which  will  be  lost  on  each  turn  and  leg,  plan¬ 
ning  a  course  down  through  space  which  will  bring  him  to  tho  ground 
headed  upwind  in  tho  middlo  of  a  suitable  field.  At  high  altitudes, 
the  earth  appears  to  be  moving  very  slowly  and  the  pilot  must  respond 
to  relatively  slight  changes  in  the  movement  of  a  distant  terrain  which 
is  usually  not  clearly  marked  ofT  for  him  like  the  sides  and  center  of 
a  highway.  On  the  other  hand,  when  the  pilot  is  closo  to  the  ground 
in  landing,  speed  blurs  nearby  reference  points  and  lie  must  respond 
to  the  position  and  movement  of  objects  farther  away. 


354 


A  number  of  additional  consequences  flow  from  tho  fact  tlmt  tho 
air  is  a  fluid,  elastic  medium.  Crosswinds  may  produce  drift.  In 
landing,  it  is  especially  important  for  the  pilot  to  correct  for  drift 
by  pointing  the  nose  slightly  upwind  and  then  straightening  his  air¬ 
plane  out  just  before  it  touches  the  ground.  If  he  does  not  do  this, 
there  will  be  a  sideward  component  to  his  landing  which  will  strain 
the  landing  gear  and  may  throw  him  into  a  ground  loop.  Discrimi¬ 
nating  the  differences  between  the  type  of  relative  movement  of  tho 
foreground  produced  by  slight  tendencies  to  drift  and  that  produced 
by  slight  tendencies  to  turn  presents  the  student  with  a  new  ami 
difficult  proble.n,  especially  since  this  discrimination  must  be  made 
against  an  unsteady  background  of  wavering  movement  produced 
by  slight  turbulence.  Furthermore,  tho  student  must  bo  doing  a 
number  of  other  things  at  tho  samo  time  and  constantly  be  alert  to 
compensate  for  tho  effects  of  sudden  gusts. 

At  high  air  speeds  a  slight  movement  of  the  controls  will  produco 
a  considerable  effect;  wl  en  the  air  speed  is  lower,  as  in  landing,  much 
more  extensive  movements  arc  required  to  produce  the  same  results. 
Though  tho  extent  of  movement  differs  greatly,  the  amount  of  pressuro 
exerted  on  the  controls  in  producing  these  movements  remains 
approximately  the  same.  Tho  student,  therefore,  must  learn  to 
control  his  aircraft  in  terms  of  pressures  instead  of  movements. 

Sinco  the  airplane  will  stall  and  full  unless  its  speed  is  maintained, 
flying  is  paced.  Tho  student  pilot  cannot  slow  down  or  st  op  as  an 
inexperienced  driver  can,  whenever  tho  task  gets  beyond  him*  Bcforo 
he  lias  had  sufficient  practico  to  enablo  him  to  make  quickly  and 
automatically  the  various  types  of  perception  and  response,  tho  new 
student  is  likely  to  be  continually  falling  behind  the  pace  of  tho  tnsk. 
As  liis  skill  increases,  the  student  becomes  better  able  to  keep  up,  but 
bcforo  one  maneuver  becomes  thoroughly  learned,  the  fast-moving 
military  curriculum  is  likely  to  confront  hint  with  a  new  and  moro 
complex  task. 

Closely  allied  to  the  paced  nature  of  the  task,  is  tho  problem  of 
division  of  attention.  Much  of  the  difficulty  of  flying  is  derived  not 
so  much  from  the  demands  of  each  of  tho  separato  tasks  as  from  tho 
fact  that  the  pilot  has  to  keep  track  of  a  number  of  different  things 
simultaneously.  For  example,  in  landing  ho  must  watch  for  other 
planes,  plan  to  land  in  tho  first  third  of  the  field,  correct  for  drift, 
keep  his  wings  level,  maintain  the  proper  gliding  air  speed,  judge  his 
height  above  the  ground,  and  finally,  achieve  a  three-point  attitudo 
just  before  the  airplane  touches  the  ground.  Ilis  attention  must  bo 
shifted  rapidly  among  all  of  these  different  factors.  Furthermore, 
correcting  any  given  error,  for  example,  too  much  air  speed,  may 
require  a  little  time.  During  this  time  the  pilot  must  shift  his  atten¬ 
tion  to  check  other  things,  finally  coming  back  to  see,  for  example, 
whether  ho  has  slowed  down  to  the  proper  air  speed.  Before  tho 
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proper  reactions  to  various  stimuli  have  become  more  or  less  auto¬ 
matic,  the  need  for  keeping  track  of  n  largo  number  of  different 
factors  places  a  severe  strain  on  the  student  pilot. 

In  addition  to  the  special  demands  placed  upon  a  pilot  by  tho 
characteristics  of  tho  new  medium  through  which  ho  travels,  it  is 
necessary  for  him  to  bo  well  motivated  in  order  to  survive  the  rigorous 
course  of  training  and  to  be  adjusted  emotionally  to  tho  unfamiliar 
and  somewhat  dangerous  conditions  of  flying.  Ho  must  also  under- 
si  a  i  d  tho  design  and  function  of  his  equipment  in  order  to  get  maxi¬ 
mum  performance  under  the  emergency  conditions  of  combat  and 
have  a  knowledge  of  weather  and  navigation  in  order  to  plan  flights 
properly. 

Flying  is  a  complex  task  requiring  many  different  abilities.  Tho 
fact  that  tho  best  printed  tests  in  tho  classification  battery  used  during 
the  war  were  found  to  predict  flying  ability  at  least  as  well  as  tho  best 
apparatus  tests,  confirms  tho  observation  that  perception,  visualiza¬ 
tion  of  spatial  relationships,  knowledge  of  mechanical  principles,  and 
motivation  aro  important  factors  in  learning  to  fly.  Tho  fact  that  tho 
addition  of  apparatus  tests  to  this  battery  improved  its  ability  to 
predict,  suggests  that  motor  skill  and  ability  to  perform  a  complox 
paced  task  aro  also  important  factors. 

The  flying  experience  of  members  of  the  Pilot  Project  ha?  empha¬ 
sized  tho  difficulty  of  making  exact  statements  a’mut  tho  rclativo  im¬ 
portance  of  different  abilities.  Tho  task  of  flying  is  complox  and 
requires  a  largo  number  of  abilities.  Ir.  many  instances  a  givon  error 
or  deficiency  in  performance  may  bo  produced  by  any  ono  of  a  largo 
number  of  causes.  For  cxnmplo,  tho  studont  may  bccomo  tenso  and 
emotionally  upset  because  ho  has  difficulty  in  dividing  his  attention 
or  he  may  hnvo  difficulty  in  dividing  his  attention  because  ho  is  tenso 
or  emotionally  upset.  Furthermore,  difficulty  in  dividing  attention 
may  arise  bccauso  of  poor  nativo  ability  to  discriminate  somo  of  tho 
cues,  bccauso  tho  student  has  not  yet  learned  to  respond  automatic¬ 
ally  to  the  cues  and  hcnco  must  pay  special  attention  to  them,  or 
simply  because  tho  student  has  not  been  told  how  most  efficiently  to 
shift  his  attention  from  ono  cuo  to  nnothcr.  Finally,  ono  may  put 
forward  the  hypothesis  that  somo  students  cannot  keep  track  of  every¬ 
thing  bccauso  they  havo  narrow  spans  of  attention. 

It  may  bo  that  attempts  to  mako  a  moro  penetrating  analysis  of 
flying  skill  will  not  bo  very  profitable  until  knowledge  of  simpler 
psycho-motor  skills,  in  situations  which  nrc  easier  to  control,  has  been 
increased  and  a  clearer  idea  is  developed  of  tho  general  structure  of 
human  perceptual,  motor  and  intellectual  abilities.  Until  knowledge 
is  greatly  increased  so  that  it  is  easier  to  put  an  analysis  of  tho  pilot's 
task  into  words,  it  will  be  desirable  for  psychologists  working  on  pilot 
aptitude  tests  or  training  research  to  secure  the  necessary  information 
nboi  t  flying  by  taking  a  certain  amount  of  systematic  pilot  training. 
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SUBJECTIVE  MEASURES  OF  FLYING  PROFICIENCY 

One  of  the  most  important  uses  of  measures  of  Hying  proficiency  was 
to  separate  the  students  into  two  groups:  Those  who  should  continuo 
and  those  who  should  be  eliminated  from  further  Hying  training. 
Because  of  its  great  practical  importance,  moro  care  was  devoted  to 
deciding  who  should  bo  failed  than  to  assigning  other  (lying  grades. 
Usually  the  check  rider  examined  tho  student’s  previous  grades  and 
discussed  them  with  the  instructor  before  the  (light  in  order  to  know 
what  weaknesses  to  look  for.  After  tho  check  ride,  he  almost  invari¬ 
ably  took  into  account  tho  opinion  of  the  instructor  which  was  based 
on  much  moro  extensive  contact  with  tho  student.  Students  were 
given  an  average  of  four  check  rides  during  primary  training.  The 
clear-cut  eases  (best  and  poorest  students)  received  fewer  than  four 
while  doubtful  eases  wero  given  as  many  ns  a  dozen  cheek  rides.  Tho 
system  of  grading  these  rides  was  entirely  subjective  in  terms  of  cate¬ 
gories  such  as  A,  B,  0,  D,  E,  and  F,  with  a  great  concentration  of 
grades  in  tho  category  of  C. 

As  with  all  systems  of  subjective  grading,  there  were  considerable 
differences  in  the  standards  of  different  check  pilots  in  the  same 
school  and  of  different  groups  of  the  cheek  pilots  at  various  schools. 
Theso  wero  reflected  in  the  wartime  elimination  rates  of  different 
classes  from  different  schools  which  ranged  from  a  low  of  10  percent 
to  a  high  of  60  percent.  Tho  differences  between  schools  and  classes 
wero  much  greater  than  would  be  expected  by  chance.  They  could 
not  be  accounted  for  by  differences  in  the  average  level  of  aptitude 
of  tho  students  as  measured  by  the  pilot  stannic.  Such  differences 
arc  of  course  inefficient  because  they  mean  that  whether  or  not  tho 
student  is  eliminated  may  depend  ns  much  on  whether  ho  happens 
to  be  sent  to  an  easy  or  a  difficult  school  as  upon  his  flying  ability. 

When  flying  grades  are  used  as  a  basis  for  elimination,  they  nro 
really  predictions  of  what  the  student  will  do  in  subsequent  training. 
A  grade  of  “B”  should  mean  that  the  student  will  have  a  good  chanco 
to  succeed  in  subsequent  training  while  a  grade  of  “F"  should  mean 
that  the  student  will  be  dangerous  to  himself  and  others  if  he  is  allowed 
to  continuo. 

The  correlation  between  different  grades  given  at  the  same  school 
was  not  a  very  useful  index  of  their  true  validity  in  predicting  flying 
ability  because  the  two  grades  were  never  independent  judgments. 
As  has  already  been  pointed  out,  the  check  riders  and  instructors 
always  discussed  the  student  in  order  to  secure  the  best  possiblo 
picture  of  his  total  performance.  When  grades  at  one  school  aro 
compared  with  those  ot  the  next,  for  example  Primary  compared 
with  Busic,  this  error  does  not  occur  because  the  instructors  in  the 
moro  Advanced  school  do  not  pay  much  attention  to  the  grades 
which  have  been  given  at  the  more  elementary  level. 
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Whenever  the  grades  at  one  level  of  training  were  compared  with 
those  at  the  next,  the  correlations  were  invariably  quito  low,  ranging 
between  0.20  and  0.35.  In  a  typical  study  on  2,905  students,  tho 
correlations  between  grades  in  Primary  and  Basic  was  0.27.  Even 
when  allowances  aro  made  for  the  fact  that  tho  rango  has  been 
restricted  by  elimination  of  the  poor  students  at  tho  Primary  level, 
these  correlations  indicate  poor  prediction.  In  fact,  the  pilot  stanino, 
based  on  objective  tests  administered  on  the  ground  to  tho  students 
before  they  entered  preflight  school,  seemed  to  predict  the  flying 
grades  in  Basic  school  as  well  as  did  Primary  grades  which  were  based 
on  subjective  observation  of  ten  weeks  of  flying  training  in  tho  air. 

Like  most  subjeetivo  judgments,  the  flying  grades  appear  to  involve 
a  strong  halo  effect.  The  intercorrelations  among  grades  for  different 
maneuvers  and  different  aspects  of  flying  were  quito  high,  suggesting 
that  tho  instructor  was  influenced  by  his  general  opinion  of  tho 
student  and  tended  to  minimizo  the  weak  points  of  good  students 
or  the  strong  points  of  poor  ones.  These  high  intcrcorrclations 
reduced  tho  possibility  of  using  grades  on  different  aspects  of  flying 
performance  to  diagnose  specific  weaknesses  for  corrective  training, 
to  validate  specific  aptitude  tests,  or  to  select  students  for  different 
kinds  of  specialized  training. 

Scores  derived  from  tho  comments  which  tho  instructors  wrote  on 
tho  students’  errors  had  lower  intercorrelations  and  showed  more 
promise  of  possiblo  usefulness  as  differential  criteria.  A  factor  analy¬ 
sis  of  these  scores  yielded  several  independent  factors  some  of  which 
were  predicted  by  the  pilot  aptitude  tests  and  others  of  which  wore  not. 
Thus  it  suggested  areas  in  which  no\*  tests  should  bo  developed.  A 
check  list  derived  from  an  analysis  of  tho  instructor’s  comments  would 
probably  bo  a  useful  addition  to  tho  present  grade  slip. 

OBJECTIVE  MEASURES  OF  FLYING  SKILL 

^  In  objective  measurement  absoluto  (in  addition  to  rclativo)  agree¬ 
ment  among  observers  is  achieved  by  using  a  permanent  independent 
standard.  Instead  of  using  subjeetivo  standards  such  ns  “poor”  or 
“too  slow”  which  are  dependent  upon  tho  individual  making  the 
judgment,  the  performance  is  defined  in  terms  of  a  permanent  stand¬ 
ard,  such  as  a  reference  point  on  tho  plane  or  an  instrument  rending, 
which  is  relatively  independent  of  tho  specific  observerJ^To  the 
extent  that  sueli  standards  can  bo  clearly  defined,  different  observers 
v. ill  give  the  same  absolute  grade  to  the  performance.  It  is  obvious 
that  if  tl  ns  type  of  standard  can  be  achieved,  it  will  tend  to  reduce  tho 
differences  among  the  elimination  rates  at  different  schools. 

In  addition  to  achieving  absolute  agreement  among  observers  by 
the  use  of  a  permanent  independent  standard,  tho  task  must  be 
clearly  defined  to  the  student  and  administered  under  controlled  con- 
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ditions.  In  tho  first  place,  the  student  must  know  exactly  wlmt  ho  is 
expected  to  do;  ho  must  bo  told  how  tho  various  measures  of  a  given 
maneuver  will  bo  scored  and  weighted.  This  is  especially  necessary 
in  flying  because  it  is  a  complex  task  in  which  the  student  can  improvo 
ono  part  of  his  performance  at  tho  expense  of  another  by  shifting  his 
attention.  If  tho  task  is  not  clearly  defined,  two  students  with  tho 
same  ability  may  get  different  scores  bccauso  they  havo  different 
opinions  concerning  what  they  aro  supposed  to  do.  Similarly,  unless 
conditions  aro  standard,  tho  scores  will  reflect  variations  in  theso  con¬ 
ditions  as  well  as  in  the  skill  of  tho  student.  Tho  airplano  is  a  com¬ 
plex  and  variablo  picco  of  equipment  and  tho  air  is  an  unstablo  labor- 
atoiy  with  changes  in  wind,  turbulence  and  density.  For  theso 
reasons  control  of  tho  conditions  of  testing  is  an  especially  difficult 
problem  in  securing  standardized,  objcctivo  measures  of  flying  skill. 

Most  of  tho  work  of  tho  Psychological  Research  Project  (Pilot) 
in  this  now  area  was  concentrated  on  developing  methods  for  enabling 
tho  check  pilot  or  instructor  to  sccuro  objcctivo  scores  using  tho 
equipment  available  on  tho  averago  army  airplano.  This  approach 
mado  it  possiblo  to  sccuro  a  broader  view  of  tho  relatively  unexplored 
area  of  research  than  would  bo  possiblo  if  work  had  been  concentrated 
on  the  much  slower  process  of  developing  recording  instruments 
and  analyzing  their  records.  Furthermore,  sinco  no  new  equipment 
is  required,  it  is  much  easier  to  put  tho  measures  dovolopcd  into 
immediate  practical  use.  After  tho  area  is  thoroughly  explored,  a 
better  basis  will  bo  available  for  tho  logical  development  of  recording 
devices  for  situations  in  which  more  accurato  measurements  are 
needed.  Tho  general  soundness  of  this  approach  was  indicated  by 
the  fact  that  in  many  instances  it  has  been  possiblo  to  nmko  tho 
measures  objcctivo  enough  so  that  observers  agree,  only  to  find  that 
tho  chief  sourco  of  difficulty  was  not  in  errors  of  measurement  but 
in  erratic  day-to-day  fluctuations  of  performance. 

Sources  of  Unreliability 

In  order  to  bo  useful,  a  measure  must  bo  rcliablo.  If  ono  adminis¬ 
tration  of  a  measure  docs  not  predict  a  second  administration  of  tho 
same  measure,  it  cannot  bo  expected  to  predict  anything  elso. 

Lower  reliability  when  test  and  retest  are  administered  on  different 
days. — Ono  general  finding,  in  tho  research  of  tho  Pilot  Project  at 
all  levels  of  training,  is  that  tho  agreement  between  repetitions  of 
tho  samo  objcctivo  measure  on  different  days  is  much  lower  than 
that  between  repetitions  on  tho  samo  day.  At  the  Primary  levol  of 
training,  tho  reliability  of  objcctivo  measures  on  310  pairs  of  accuracy 
landings  with  test  and  retest  in  immediate  succession  was  0.12  for 
zono  of  landing,  0.32  for  landing  attitude,  and  0.32  for  whether  tho 
airplano  was  dropped  in  or  bounced  more  than  3  feet.  When  a 
test  and  retest  were  on  different  days,  in  different  airplanes  with 
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different  check  riders,  those  reliabilities  were  reduced  to  0.02,  0.04, 
and  0.00  respectively.  In  a  similar  comparison  on  a  representative 
high  altitude  maneuver,  tho  reliability  of  altitude  deviation  in  a 
steep  turn  was  found  to  be  0.38  when  tho  turns  wero  given  in  immediate 
succession  and  0.17  when  they  wero  on  different  days  and  in  different 
airplanes  by  different  check  riders.  Similarly,  for  instrument  flying 
at  the  Basic  level  of  training,  tho  reliability  of  altitudo  deviation  in 
strnight-and-lcvcl  flight  was  0.59  when  test  and  retest  were  given 
in  immediate  succession  and  0.21  when  they  were  administered  on 
(lilToront  days.  For  altitudo  deviation  in  instrument  steep  turns, 
the  correlation  was  0.55  for  immediate  succession  and  0.24  for  dif¬ 
ferent  days.  Finally,  tho  same  typo  of  difference  was  observed 
for  the  total  score  on  tho  check  rido  to  mcasuro  instrument  flying 
in  tho  AT-G.  Tho  correlation  between  tho  odd  and  even  items  of 
this  ride  (corrected  for  doublo  length)  was  0.91  on  tho  first  day  and 
0.89  on  the  second  day,  but  the  correlation  between  the  total  scores 
on  theso  two  days  was  only  0.46. 

The  large  drop  in  reliability  when  test  and  retest  are  administered 
on  different  days  docs  not  seem  to  bo  limited  to  objective  measures  of 
flying  skill;  it  is  also  found  in  other  measures  of  complox  types  of 
performance  in  tho  air.  In  measuring  "distanco  off,”  tho  ultimate 
criterion  of  successful  navigation,  tho  Psychological  Research  Project 
(Navigator)  found  that  tho  reliability  of  different  legs  of  tho  same 
mission  was  0.44.  When  tho  results  of  missions  on  different  days 
were  compared,  however,  tho  reliability  dropped  to  —0.07.  Similar 
results  wero  found  for  tho  computations  of  air  speed  drift,  and  other 
specific  aspects  of  tho  task  which  contributed  to  tho  final  result  of 
"distanco  off.”  •* 

Flexible  gunnery  scores  present  a  similar  picture.  In  one  of  the 
best  controlled  studies  using  tho  gun  camera  and  B-29  sighting  equip¬ 
ment,  the  reliability  of  attacks  within  a  mission  was  0.72  whilo  tho 
correlation  between  missions  flown  on  different  days  in  different  air¬ 
planes  dropped  to  0.27.”  Finally,  in  a  study  of  bombing  accuracy 
the  correlation  between  measures  of  circular  error  was  found  to  bo 
0.5G  for  odd-even  releases  and  0.03  for  odd-oven  missions.” 

Implications  oj  drop  in  correlation  when  test  and  retest  are  given  on 
different  days. — Tho  drop  in  tho  reliability  of  objcctivo  measures  of 
flying  skill  when  test  and  retest  wero  given  on  different  days  in 
different  airplanes  by  different  check  riders  has  threo  important  im¬ 
plications:  (1)  Any  estimates  of  reliability  which  aro  based  on  the 
comparison  of  odd  and  even  items  or  test  and  retest  within  tho  samo 


*•  Pre  chnph-r  (1  of  Report  No.  10  of  this  series,  P/ycKelotUnl  Rtunrrh  on  .V«a Ignticr  Tralnlnf. 

*  An  un|"iM!>lie<l  »tii>ly  by  tho  Dep-irtmenl  of  Psychology,  School  of  Avbtion  MeOlilne.  Pec  also 
clnpter  Oof  No.  II,  Pt/diolotfltal  Rtitartk  on  f'lnlUt  Ounr.tr/  Tttlnin/,  prewired  by  Psychological  Re- 
Unroll  Volt,  No.  II. 

*  S< -e  the  discussion  of  table  2.11  In  Chapt  2  of  Report  No.  9,  Pi/(holofleal  Rtttar eh  *■.».  Pombatiltr 
Ttalnln/. 
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flight  will  greatly  overestimate  tho  typo  of  reliability  which  haa 
significant  in  tho  practical  situation,  namely  tho  ability  of  the 
measure  to  give  consistent  results  ovor  a  period  of  time;  (2)  in  any 
check  ride  used  to  measure  tho  results  of  training  experiments,  it  is 
important  to  control  the  effects  of  conditions  of  testing  by  measuring 
matched  pairs  of  experimental  and  control  subjects  as  nearly  in 
succession  as  possiblo  in  tho  saino  airplane  and  by  tho  samo  check 
rider;  (3)  if  a  reliablo  measuro  of  the  individual  student  is  desired, 
check  rides  must  bo  repeated  on  a  sufficient  number  of  days  in  dif¬ 
ferent  airplanes  by  different  check  riders  so  that  it  will  bo  possiblo  to 
averago  out  tho  effects  of  variations  in  conditions  of  testing  and  of 
fluctuations  in  tho  individual’s  ability  to  perform. 

Relatively  good  agreement  between  inde])endent  observers. — Tho  fact 
that  tho  measures  arc  considerably  moro  reliablo  when  test  and  retest 
are  given  in  tho  same  flight  suggests  that  a  considerable  part  of  tho 
low  reliability  when  test  and  retest  aro  given  on  different  days  is 
caused  by  variations  in  tho  performance  measured  rather  than  by 
errors  in  measuring  that  performance.  This  conclusion  is  furthor 
confirmed  by  tho  fact  that  thcro  is  fairly  good  agreement  botwcon 
measurements  of  different  observers  scoring  tho  samo  thing  at  tho 
samo  time.  For  accuracy  landings  at  tho  primary  level  of  training, 
tho  scores  by  observers  in  tho  airplano  and  on  tho  ground  correlated 
with  each  othor  0.83  for  zono  of  landing,  0.79  for  landing  attitude,  and 
0.88  for  dropped  or  bounced  moro  thnn  3  feet.  On  n  preliminary  form 
of  an  advanced  two-engino  check  rido,  16  out  of  tho  24  scores  had 
observer  reliabilities  of  0.80  or  abovo.”  Whilo  theso  observer  relia¬ 
bilities  aro  not  perfect,  they  aro  considerably  higher  than  the  test- 
retest  reliabilities.  This  further  confirms  the  conclusion  that  tho  low 
reliability  of  test  and  retest  on  different  days  is  to  bo  attributed  to 
erratic  changes  in  performance  rather  than  to  errors  in  measuring  that 
performance. 

Suggestions  for  further  work. — Tho  results  which  have  just  boon 
presented  suggest  that  futuro  research  should  bo  concentrated  on  try¬ 
ing  to  standardize  conditions  of  testing  and  to  minimizo  tho  effects 
of  day-to-day  variability  in  performance.  Thcro  is  a  need  for  a  moro 
exact  and  detailed  analysis  of  tho  causes  of  the  day-to-day  variability. 
A  study  should  bo  directed  toward  determining  the  relativo  amounts 
of  varinneo  introduced  by  tho  observer,  by  the  airplane,  by  wcathor, 
and  by  changes  in  tho  level  of  the  performance  of  the  individual.  A 
moro  exact  knowledge  of  tho  causes  of  variability  should  provide  a 
better  rational  basis  for  devising  means  to  copo  with  tho  problem. 

Tho  problem  of  variability  in  performance  is,  of  course,  a  general 
problem  which  is  not  limited  to  performance  in  tho  air.  Thero  is 


*  Etch  of  the*  » turtle!  In  volvcd  •  number  of  different  (nln  of  observed.  Since  no  correction*  wet*  roads 
for  nnjr  differences  between  the  different  pslr*  of  oKvrvcr*.  the  correlation  coefficients  represent  abaolut*  a* 
well  u  rtUUv*  agreement. 
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some  suggestion  in  tho  work  of  the  Department  of  Psychology  at  the 
School  of  Aviation  Medicine  that  as  psychomotor  tests  aro  made  more 
complex,  the  reliability  of  measurements  based  on  a  given  length  of 
performance  tends  to  be  reduced.  It  seems  possiblo  that  tho  moro 
readily  controlled  apparatus  test  situation  could  bo  used  to  discover 
certain  fundamental  principles  which,  in  turn,  might  help  to  guido 
research  on  the  development  of  objective  measures  of  flying  skill.  It 
wo  id  be  instcresting  to  uso  this  kind  of  test  to  study  problems  such 
ns  (1)  Tho  effect  of  tho  complexity  of  a  task  upon  its  reliability, 
(2)  the  efTcct  of  tho  interval  between  test  and  retest  upon  their  cor¬ 
relation,  (3)  how  this  effect  varies  with  tho  complexity  of  tho  task, 
(4)  the  effect  of  different  methods  of  scoring  upon  reliability,  and  (5) 
the  effect  of  having  tho  subject  know  oxactly  how  he  is  scored  upon  tho 
reliability  of  tho  scoro. 

One  of  tho  ways  to  deal  with  variability  of  performance  is  to  average 
it  out  by  repeating  tho  measurements  on  a  sufficient  number  of  flights. 
This  suggests  the  desirability  of  further  work  on  objcctivo  measures 
for  the  daily  grade  slip. 

Relationships  Among  Different  Indices  Used  to  Evaluate  Measures 

Each  of  tho  objcctivo  measures  of  flying  skill  developed  by  the 
Pilot  Project  was  evaluated  in  a  number  of  different  ways.  It  was 
possiblo  to  gather  a  certain  amount  of  data  on  tho  relationships 
among  various  criteria  for  tho  goodness  of  each  measure. 

Relationship  between  reliability  and  validity. — For  the  81  items  on 
a  scalo  of  instrument  flying  at  tho  Busic  lovol  of  training,  the  validity 
of  each  measure  was  determined  by  its  correlation  with  instructors' 
ratings.  The  correlation  between  this  index  of  validity  and  the 
test-rctcst  reliability  of  each  of  tho  81  measures  was  0.34.  At  the 
Primary  level  of  training  comparable  data  wero  available  for  63 
measures.  For  theso  measures,  tho  correlation  between  test-rotest 
reliability  and  validity  as  measured  by  ability  to  predict  pass-fail 
was  substantially  zero.  Tho  correlation  between  the  reliability  of 
a  meosuro  and  its  ability  to  discriminate  botween  students  with  dif¬ 
ferent  amounts  of  training  was  also  zero.  Another  study  on  26 
measures  at  this  samo  level  of  training  also  showed  no  relationship 
between  reliability  and  validity.  Tho  lack  of  relationship  between 
reliability  and  validity  for  tho  Primary  measures  was  produced  in 
part  by  a  number  of  measures  in  which  tho  time  for  the  pilot  to  oxo- 
cuto  various  maneuvers  such  as  turns  was  recorded.  Theso  measures 
of  timo  had  very  high  reliabilities,  indicating  that  tho  pilot’s  per¬ 
formance  was  consistent  in  this  respect  from  day  to  day.  Thoy 
had,  however,  a  very  low  validity,  indicating  that  this  aspect  of  his 
performance,  though  consistent,  was  not  relevant  to  his  skill. 

Relationship  between  ability  to  discriminate  between  different  amounts 
of  training  and  ability  to  predict  pass-jail. — At  tho  Primary  lovol  of 
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training  two  different  criteria  were  used  to  evaluate  measures  of 
flying  skill:  ability  to  discriminate  among  students  with  different 
amounts  of  training,  and  ability  to  predict  whether  tho  student 
would  pass  or  fail.  Each  student  was  tested  on  two  successive  days. 
The  first  criterion  was  determined  separately  on  each  of  tho  days; 
the  second  was  determined  for  the  average  of  tho  two  days’  perform¬ 
ance.  The  correlation  between  tho  ability  of  a  measuro  to  discrimi¬ 
nate  between  students  with  different  amounts  of  training  on  the  first 
day  and  this  same  ability  on  the  second  day  was  0.41  for  tho  63 
measures  on  which  complete  data  were  available.  This  correlation 
i3  significant  at  tho  0.1  percent  level  and  indicates  that  tho  groups 
used  in  this  study  were  large  enough  to  determine  with  somo  relia¬ 
bility  tho  rank  order  of  the  measures  in  respect  to  this  criterion. 

Tho  correlation  between  tho  ability  of  each  measuro  to  discriminate 
between  students  with  different  amounts  of  training  and  its  ability  to 
predict  pass-fail  was,  however,  substantially  zero.  If  this  lack  of 
relationship  is  found  in  other  studies,  it  will  mean  that  theso  two 
types  of  criteria  are  quito  different,  and  that  tho  errors  characterizing 
tho  students  who  oro  deficient  in  cxpcricnco  nro  different  from  thoso 
characterizing  students  deficient  in  aptitude.  If  tho  relationship 
between  these  two  criteria  is  low,  two  different  scales  will  have  to  bo 
dovclopcd:  One  for  diagnosing  weaknesses  in  training,  graduating 
students  on  a  proficiency  basis  and  measuring  tho  results  of  training 
experiments,  and  another  for  deciding  which  students  should  bo 
eliminated  and  validating  aptitude  tests. 

Types  of  Measures  Developed  and  Evaluated 

Tho  largest  part  of  tho  work  of  tho  Pilot  Project  on  developing 
objective  measures  of  flying  skill  was  devoted  to  devising,  trying  out, 
and  evaluating  different  measures.  A  considerable  portion  of  this 
work  was  concentrated  on  developing  measures  relevant  to  tho 
earliest  stages  of  training  in  primary  flying  schools.  Sinco  this  was 
tho  period  when  tho  greatest  number  of  eliminations  occurred,  it  was 
believed  that  more  nccurato  methods  of  measurement  would  bo  of 
greatest  practical  value  during  this  stage  of  training.  Most  of  tho 
remainder  of  tho  work  was  concentrated  on  objcctivo  measures  of 
instrument  flying  skill,  beenuso  of  tho  extremo  importanco  of  instru¬ 
ment  flying  in  combat  and  transport,  and  bccauso  this  typo  of  Hying 
scorned  to  lend  itself  to  objcctivo  measurement. 

Tho  number  of  measures  on  which  empirical  data  havo  been 
gathered  at  each  level  of  training  is  summarized  in  table  15.1.  In 
narking  this  table  minor  variations  of  a  measuro  wero  not  counted. 
Thus,  altitude  range  in  steep  turns  to  tho  right  and  steep  turns  to 
tho  left  wo3  considered  ns  ono  measure.  However,  nltitudo  range  in 
turns,  altitude  rango  in  straight-nnd-lovel  flight,  and  nltitudo  with 
instruments  covered  and  instruments  visiblo  were  considered  separate 
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Table  15.1. — A ’umber  of  objective  measures  of  flying  skill  experimentally  tested  at 

each  level  of  training 


I’rlmrtry  phitv*  of  contact  flying . . 

Itnvic  plime  of  Inurnment  flying . 

A<U  in<v<|  luiiit-iiKliic  <T  11-2.*)  phase  of  Instrument  flying  . 

Advanced  elnclo-  un<l  ttvo-cnclnc  contact,  basic  contact,  et  al 

Total . 


Number  of 
mrnfurr* 
Investigated 

Number  of 
correlations 
calculated 

131 

1,173 

T> 

170 

111 

131 

201 

409 

m 

2,044 

measures.  In  order  to  give  a  bird’s-cyo  view  of  the  amount  of  data 
gathered,  the  table  also  reports  the  number  of  correlations  which 
have  been  calculated  for  tlio  measures  in  each  category.  When  the 
measures  for  each  level  of  training  are  summed,  it  can  be  seen  that  a 
total  of  523  different  measures  wero  tried  out  and  that  in  evaluating 
theso  a  total  of  2,044  correlation  coefficients  were  calculated. 

Different  Methods  of  Scoring 

Three  different  methods  of  scoring  instrument  flying  were  compared: 
(1)  The  timc-samplo  method  in  which  tho  check  rider  read  the  devia¬ 
tions  from  tho  corroct  altitude,  heading,  etc.  at  specified  intervals 
throughout  tho  maneuver;  (2)  the  rango  mothod  in  which  ho  scored 
the  diffcrcnco  between  tho  highest  and  tho  lowest  reading  on  an 
instrument  during  a  maneuver;  and  (3)  tho  limits  method  in  which  he 
scored  tho  singlo  largest  deviation  (in  cither  direction)  from  tho  cor¬ 
rect  reading.  In  all  tlirco  mothods  tho  observations  were  recorded 
by  marking  on  diagrammatic  representations  of  tho  instrument,  i.  e., 
altimeter  or  directional  gyro.  It  was  found  that,  although  tho  timo- 
samplo  method  had  a  higher  observer  reliability,  it  did  not  havo  a 
higher  tcst-rctost  reliability  or  higher  correlation  with  instructors’ 
grades  than  tho  rango  method.  F urthcimoro,  the  time-samplo  method 
was  harder  to  administer.  In  ono  study  tho  rango  mothod  seemed  to 
havo  higher  test-rctcst  reliabilities  and  higher  correlations  with  in¬ 
structors’  grades  than  tho  limits  method;  in  another,  tho  differences 
wero  quito  inconsistent  though  tending  to  bo  in  tho  samo  direction. 

Combining  Measures  into  a  Total  Score 

In  connection  with  tho  measures  of  instrument  flying  skill  for  the 
basic  level  of  training,  a  little  work  was  dono  on  investigating  the 
most  effective  ways  of  combining  separato  measures  into  total  scores. 
In  representative  maneuvers,  different  measures  (for  example,  alti¬ 
tude,  air  speed,  and  heading)  wero  combined  in  threo  different  ways. 
In  ono  of  theso  methods  of  combination  tho  different  measures  were 
added  up  with  equal  weights.  In  another  method  tho  amount  of 
weight  given  to  each  measure  was  determined  by  regression  equations 
to  computo  beta-weights  maximizing  tho  validity  of  tho  combined 
scoro.  In  tho  third  method  tho  w  eights  wero  determined  by  tho 
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expert  judgment  of  pilots.  Tho  weights  which  tho  pilots  recom¬ 
mended  amounted  to  a  modified  typo  of  cut-off  scoro  in  which  tho 
student  was  penalized  more  for  a  single  bad  error  in  any  ono  moasuro 
than  for  moderato  errors  in  a  number  of  measures.  These  threo 
methods  were  tried  out  in  getting  total  scores  for  measures  on  each  of 
two  representative  maneuvers:  Level  out,  and  instrument  turns. 
When  allowance  was  mado  for  tho  moderato  amount  of  shrinkago 
which  would  be  expected  when  the  beta  weights  were  cross-validated, 
theso  threo  different  methods  yielded  approximately  equal  results. 

In  selecting  and  combining  objective  measures  of  flying  skill,  a 
special  problem  has  been  encountered.  Sometimes  it  is  necessary  to 
include  a  measure  which  in  itself  is  not  reliable  or  valid  in  order  to 
make  sure  that  tho  student  adheres  to  tho  conditions  which  mako 
another,  more  important  measure  valid.  For  example,  tho  amount 
of  altitude  lost  or  gained  in  a  steep  turn  is  a  relatively  good  mcasuro. 
In  order  to  make  suro  that  the  student  performs  a  steep  turn,  however, 
it  is  necessary  to  have  some  mcasuro  of  his  anglo  of  bank.  If  tho 
student  is  not  penalized  in  somo  way  for  failing  to  maintain  a  proper 
angle  of  bank,  there  is  nothing  to  prevent  him  from  making  a  shallower 
turn  in  which  it  is  easier  to  hold  altitudo.  If  ho  is  simply  required  to 
repeat  turns  on  which  his  bank  is  not  satisfactory,  thcro  is  nothing 
to  prevent  him  from  shallowing  out  tho  bank  and  hcnco  getting 
another  chance  at  the  turn  ns  soon  as  ho  sees  that  his  altitudo  control 
is  not  going  to  bo  very  good.  Thus,  this  mcasuro  which  is  not  very 
good  on  its  ow'n  merits  must  be  included  and  given  a  weight  in  ordor 
to  establish  a  condition  for  administering  a  better  mcasuro,  altitudo 
doviation.  This  illustrates  ono  of  tho  difficulties  inherent  in  trying 
to  mcasuro  a  complex  skill  liko  piloting  on  airplane. 

Seales  Composed  of  Selected  Measures 

Tho  best  of  tho  measures  devised  and  evaluated  at  each  lovcl  of 
training  wero  selected  for  further  study.  Tho  tentative  scales  com¬ 
posed  of  theso  measures  oro  described  in  tho  chapters  dealing  with 
tho  different  aspects  of  this  work.  Only  ono  of  theso  scales  had  boon 
tried  out,  before  tho  end  of  tho  war  disrupted  training  to  tho  extent 
that  further  research  had  to  bo  suspended  temporarily.  This  seal© 
was  composed  of  81  measures  of  instrument  flying  skill  for  tho  basic 
level  of  training.  Tho  odd-even  reliability  of  this  scalo  (corrected 
for  doublo  length)  was  0.91  for  tho  first  day  of  testing  and  0.89  for 
tho  second.  Tho  reliability  of  test  and  retest  on  different  days  in 
different  airplanes  was  0.46.  From  this  it  can  bo  estimated  that  tho 
reliability  of  tho  sum  of  the  scores  for  two  check  rides  on  different 
days  w’ould  bo  0.63.  Tho  sum  of  tho  scores  for  two  check  rides  on 
different  days  correlated  0.51  with  instructors’  ratings.  Tho  check 
rides  wero  given  at  tho  ond  of  training,  tho  instructors’  ratings  wero 
mado  beforo  theso  check  rides  on  tho  basis  of  observations  throughout 
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training,  nnd  tho  check  pilots  who  administered  tho  check  rides 
were  unaware  of  these  ratings. 

Suggestions  Jor  jurthcr  work. — One  of  tho  next  steps  in  evaluating 
sueh  a  check  ride  is  to  dctcmiino  its  ability  to  predict  performance 
in  the  following,  or  advanced,  stago  of  training.  Another  step  is  to 
determine  the  reliability  and  validity  of  a  check  ride  composed  of 
tho  best  items  selected  from  this  scale. 

Tho  ability  of  tho  items  in  this  scale  to  discriminate  between  stu¬ 
dents  with  different  amounts  of  training  should  also  bo  determined. 

In  addition  to  supplying  an  index  of  tho  usefulness  of  theso  measures 
in  evaluating  the  results  of  training  experiments,  such  a  study  would 
yield  further  evidence  on  tho  fundamental  question  of  whether  or  not 
the  measures  which  are  best  ablo  to  discriminate  between  students 
with  different  amounts  of  training  arc  also  best  able  to  discriminate 
between  students  with  tho  same  training  but  different  aptitude. 

At  tho  same  timo  that  further  data  were  being  gathered  from  & 
larger  number  of  eases  on  tho  reliability  and  validity  of  the  items  and 
of  tho  total  score,  a  study  should  be  mado  of  tho  intcrcorrclations  of  i 
the  different  items.  This  might  throw  light  on  tho  structure  of 
flying  skill  nnd  would  indicate  any  duplication  which  should  be 
eliminated. 

Similar  studies  should,  of  course,  be  carried  out  on.  the  scales  do-  ( 
velopcd  for  different  types  of  flying  at  other  levels  of  training.  A 
suggested  experiment  is  described  in  more  detail  at  the  end  of  Chap¬ 
ter  6. 

USE  OF  OBJECTIVE  MEASURES  IN  A  LARGE-SCALE  STUDY 

OF  THE  EFFECT  OF  ADDITIONAL  TRAINING  ON  FLYING 

SKILL 

Whilo  it  was  still  in  tho  early  Btages  of  developing  objective  mens- .  ! 

urcs  of  flying  skill,  tho  Pilot  Project  was  asked  by  the  Chief  of  Staff 
of  tho  Training  Command  to  uso  tho  opportunity  afforded  by  some 
temporary  training  freezes  to  develop  objective  measures  for  all  lovela 
of  training  and  to  measure  tho  effects  of  additional  training  at  each 
lovel. 

The  objective  check  rides  developed  for  each  level  of  training  were 
designed  to  sample  differences  between  groups;  they  wero  not  designed 
to  bo  reliablo  enough  to  discriminate  between  individuals.  Theso 
objective  measures  wero  administered  at  36  different  schools  during  a 
singlo  week  to  test  tho  flying  skill  of  ovor  8,000  students  in  four 
different  types  of  training. 

In  the  primary,  basic,  nnd  advanced  singlc-cngino  schools,  students 
who  had  received  tho  normal  10  weeks  of  training  and  thoso  who  had 
received  an  additional  5  weeks  during  tho  freeze  (making  a  total  of  15 
weeks)  wero  tested  at  tho  samo  timo  under  comparablo  conditions. 
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The  results  showed  that  at  each  of  these  threo  levels  of  singlc-cngino 
training,  adding  an  additional  5  weeks  produced  an  improvement  in 
the  performance  of  the  students.  At  nono  of  these  levels  had  tho 
students  reached  their  limit  of  improvement  within  tho  normal  period 
of  training. 

The  fact  that  the  students  improved  with  additional  training  at 
a  given  level  docs  not  mean,  however,  that  they  would  necessarily 
benefit  more  from  that  training  than  from  being  moved  on  to  a  more 
advanced  type  of  airplane.  The  question  Ls,  to  what  extent  aro  tho 
effects  of  additional  training  on  a  lighter  piano  transferred  to  per¬ 
formance  in  flying  a  heavier  ono?  It  was  possible  to  sccuro  some 
evidence  on  this  question  in  the  measures  at  advanced  two-engino 
schools  because  tho  training  freeze  happened  to  coincido  with  a 
change  to  a  different  kind  of  airplane.  One  group  of  students  was 
available  which  had  received  10  weeks  of  normal  advanced  two- 
engino  training  on  tho  lower  powered  AT-17  or  AT-10  followed  by 
5  weeks  on  the  faster  and  heavier  TB-25  (Mitchell  bomber),  making 
a  total  of  15  weeks.  Another  group  of  students  had  received  10 
weeks  of  advanced  two-engine  training,  all  on  tho  TB-25.-  Tho 
results  showed  that,  in  general,  10  weeks  of  training,  all  on  tho  TB-25 
was  better  than  15  weeks  of  training,  10  of  which  was  on  a  lower- 
powered  two-engino  airplane  and  only  5  on  tho  TB-25.  Apparently, 
tho  transfer  of  training  was  imperfect  enough  so  that  5  weeks  on  tho 
larger  airplane  was  of  more  value  in  learning  to  fly  it  than  10  on  tho 
smaller  one. 

Another  group  of  students  had  15  weeks  of  training,  all  on  tho 
TB-25.  In  general,  theso  students  were  tho  best  of  all,  but  the 
additional  training  did  not  help  all  aspects  of  their  performance. 
During  the  additional  training,  there  was  a  tendency  to  forget  thoso 
aspects  of  procedure  which  were  emphasized  during  tho  first  weeks 
and  relatively  neglected  later  on. 

Finally,  single-engine  students  who  had  had  enough  civilian  flying 
to  solo  before  entering  primary  were  compared  with  thoso  who  had 
not.  It  was  found  that  during  tho  earlier  phases  of  military  training, 
the  students  who  had  soloed  before  primary  were  definitely  superior 
to  thoso  who  lmd  not.  The  difference  between  theso  two  groups, 
however,  did  not  seem  to  persist  beyond  tho  basic  level  of  flying 
training.  These  results  are  in  lino  with  what  is  known  about  tho 
effects  of  previous  civilian  flying  upon  the  likelihood  that  tho  student 
would  be  eliminated  at  tho  different  levels  of  training.  Tho  results 
of  investigations  on  fixed  gunnery  also  indicated  that  by  tho  tiino  tho 
students  had  reached  that  advanced  stage  of  training,  there  was  no 
difference  between  those  who  lmd  soloed  before  entering  primary 
and  thoso  who  had  not. 

Tho  fact  that  it  was  possible  to  achiovo  theso  results  when  tho 
measures  were  administered  to  over  8,000  students  in  a  singlo  week 

367 


I 


indicates  that  it  is  practicable  to  employ  objective  measures  of  flying 
skill  in  evaluating  tho  results  of  a  large-scale  pilot-training  program. 

GENERAL  RECOMMENDATIONS  FOR  DEVELOPING  OBJEC- 
TIVE  AND  SUBJECTIVE  MEASURES  OF  FLYING 

A  scientifically  constructed  grade  slip. — Day-to-day  fluctuations  in 
performance  appear  to  be  ono  of  tho  greatest  sources  of  difficulty  in 
securing  good  measures  of  flying  proficiency.  One  way  of  dealing 
with  these  is  to  average  them  out  by  measuring  performance  on  a 
sufficient  number  of  days.  The  difficulty  in  administering  a  large 
number  of  special  check  rides  suggests  that  it  would  bo  desirable  to 
investigate  the  possibility  of  improving  the  doily  grade  slip  which  is 
filled  out  by  the  instructor  on  each  dual  ride.  Various  experimental 
forms  of  grade  slips  should  be  tried  out  and  scientifically  evaluated. 
Objective  measures,  relevant  to  the  particular  stage  of  training, 
should  be  included  in  tho  grade  slips.  Such  measures  will  servo  as 
useful  points  of  reference  and  it  is  believed  that  they  will  tend  to 
exert  a  standardizing  influence  upon  tho  entire  grodc  slip. 

A  check  list  should  be  devised  for  recording  the  most  frequent  and 
important  types  of  errors  as  determined  by  analyses  of  instructors’ 
comments  similar  to  the  ones  reported  in  chapter  5.  Such  a  check  list 
will  tend  to  standardize  tho  comments  and  make  it  much  easier  to 
determine,  for  example,  which  kinds  of  errors  in  Primary  aro  most 
predictive  of  poor  performance  at  Basic.  A  blank  spaco  should  be 
provided  for  writing  in  comments  not  adequately  covered  by  the 
check  list. 

Finally,  this  grade  slip  should  contain  such  subjective  grades  as 
may  be  necessary  to  deal  with  aspects  of  performance  which  cannot 
easily  be  covered  by  tho  objective  mensures  or  tho  check  list. 

Some  simple  system  should  bo  worked  out  for  sumir  *izing  the 
facts  on  the  grade  slip  into  total  scores  on  over-all  pcrL  ance,  and 
possibly  on  a  few  different  relatively  independent  ospccts  of  perform¬ 
ance.  Thcro  should  also  bo  a  simple  system  for  summarizing  the 
daily  grades  on  each  subphase  of  training  at  a  school.  It  is  bclioved 
that  if  sufficient  ingenuity  is  devoted  to  the  problem,  a  grade  slip 
can  be  designed  which  will  contain  moro  valuable  information  in  a 
more  usablo  form,  and  yet  be  easier  to  fill  out  than  it  is  to  write  in 
comments  conscientiously  on  tho  present  typo  of  grade  slip. 

Each  item  on  this  grade  slip  should  bo  scientifically  evaluated;  the 
predictive  powers  of  the  objective  items,  tho  check  list  and  subjective 
items  should  bo  compared.  It  would  also  bo  dcsirablo  to  compare 
tho  predictive  power  of  tho  instructor’s  over-all  subjective  evaluation 
with  that  of  a  total  of  tho  scores  on  each  of  tho  items.  In  making  his 
over-all  subjective  evaluation  of  the  check  ride,  tho  instructor  should 
bo  allowed  to  know  the  results  of  studies  showing  tho  correlation  of 
each  tync  of  error  with  failuro  in  subsequent  training. 
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The  results  of  a  study,  reported  in  chapter  8,  in  which  students 
were  graded  on  each  dual  instrument  ride,  appears  to  indicato  that 
this  more  rigorous  typo  of  grading  does  not  interfere  with  training, 
but  if  anything,  produces  students  who  can  fly  with  greater  precision. 

Mechanical  recording. — As  relevant  aspects  of  performance  aro 
located  by  thorough  exploratory  work,  it  may  be  worth  while  to  try  to 
develop  mechanical  aids  to  simplify  the  check  pilot’s  task.  In  some 
eases  it  may  be  necessary  to  make  a  detailed  record  of  performance  in 
order  to  decide  which  aspect  should  be  measured.  In  general,  how¬ 
ever,  it  is  believed  that  the  recording  devices  should  be  designed  to  yield 
total  scores  which  can  be  immediately  read  from  a  dial  for  each 
aspect  of  behavior  sampled.  For  example,  a  work  adder  or  a  move¬ 
ment-counter  typo  of  device  might  be  attached  to  the  throttle,  stick 
or  rudder.  It  might  bo  desirable  to  have  the  device  record  changco 
in  pressure  on  the  stick  and  rudder  rather  than  mo\  cments.  A  simple 
photo-electric  recorder  might  be  designed  to  integrate  the  total 
amount  of  movement  of  the  needles  on  the  altimeter,  directional  gyro, 
etc.  All  of  theso  devices  should  be  designed  so  that  the  check  pilot 
could  start  them  at  the  beginning  of  a  maneuver  nnd  stop  them  at  the 
end,  or  so  that  they  could  bo  set  to  run  for  a  given  period  of  time. 
Then  the  check  pilot  could  read  the  dials  and  zeroizo  them  at  leisure 
after  each  exercise  was  completed.  It  might  be  possiblo  to  design  for 
each  instrument  a  pair  of  exceedingly  light  auxiliary  hands  which 
could  be  zeroized  at  the  beginning  of  a  maneuver  and  would  record  tho 
maximum  deviation  in  cither  direction  on  that  instrument  during  tho 
maneuver. 

FIXED  GUNNERY 

Flying  tho  airplane  in  such  a  way  that  tho  bullets  from  tho  guns 
fixed  to  it  would  hit  a  target  was  a  relevant  part  of  tho  fighter  pilot’s 
task,  required  considerable  skill,  and  yielded  an  objective  scoro.  A 
number  of  studies  of  fixed  gunnery  were  made.  First,  tho  differences 
between  classes  and  schools  were  studied  and  found  to  bo  important. 
It  was  found  difficult  to  control  these  differences  or  to  dovelop  correc¬ 
tions  for  tho  underlying  factors  such  as  geographical  and  seasonal 
variations  in  turbulence  and  visibility.  Tho  best  way  to  sccuro  tho 
most  relevant  scores,  therefore,  seemed  to  be  to  normalize  tho  data,  or 
analyze  them  separately,  for  each  class  and  school. 

Although  the  results  of  a  single  day’s  firing  wero  comparatively 
unreliable,  the  results  for  tho  entire  perj^l  of  training  yielded  rela¬ 
tively  reliable  scores.  For  1,0G4  students  the  odd-even  reliability 
(corrected  for  double  length)  of  1,200  rounds  of  air-to-air  firing  %vas 
0.63.  Similarly,  for  032  students  the  reliability  of  400  rounds  of  air- 
to-ground  firing  was  0.59.  Although  tho  students  wero  learning 
throughout  this  performance,  an  empirical  check  demonstrated  that 
tho  reliability  varied  with  tho  number  of  rounds  sampled  in  approxi- 
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mately  tho  wfty  which  would  bo  predicted  from  the  Spearman-Brown 
formula.  That  somewhat  different  skills  ',’crc  involved  in  air-to-air 
and  air-to-ground  firing  w’as  indicated  by  tho  fact  that  for  1,175 
students  tho  correlation  between  these  two  types  of  scores  was 
only  0.22. 

Tho  equally-weighted  sum  of  air-to-air  and  air-to-ground  fixed 
gunnery  scores  in  tho  Training  Command  correlated  0.38  with  a  similar 
score  in  the  First  Fighter  Command.  The  fact  that  the  correlation  is 
no  higher  than  this  suggests  that  tho  task  of  fixed  gunnery  in  the 
tactical  airplanes  in  tho  First  Fighter  Command  is  considerably 
different  from  that  in  the  lighter  airplanes  in  tho  Training  Command. 
In  view  of  this  difference  and  the  fact  that  the  learning  curves  were  still 
going  up  steeply  at  tho  end  of  tho  amount  of  practice  given  in  the 
Training  Command,  it  would  seem  highly  desirable  to  conduct  an 
experiment  to  sco  how  much  different  amounts  of  training  in  fixed 
gunnery  in  the  Training  Command  would  transfer  to  performance  in 
the  First  Fighter  Command. 

Finally,  on  n  sample  of  1,000  students,  the  pilot  stanine  was  found 
to  cordate  0.19  with  an  equally  weighted  combination  of  air-to-air 
and  air-to-ground  fixed  gunnery  scores.  Thoso  tests  in  tho  classifi¬ 
cation  batteiy  which  had  tho  highest  correlations  with  tho  criterion  of 
pnss-fail  in  primary  training  also  tended  to  have  tho  highest  correla¬ 
tions  with  fixed  gunnery  scores  in  transition  training. 

PRINTED  TESTS  OF  FLYING  INFORMATION 
Need  and  Method 

Reports  from  combat  thcatcis  stressed  tho  fact  that,  in  addition 
to  flying  skill,  the  combat  pilot  had  to  havo  good  judgment,  based  on  a 
thorough  knowledge  of  practical  aerodynamics,  engines  and  equip¬ 
ment,  navigation,  weather,  and  principles  of  instrument  flying.  In 
order  to  get  maximum  performance,  the  pilot  had  to  have  a  knowledge 
of  tho  flying  characteristics  of  his  airplano.  Since  enemy  fire  created 
sudden  emergencies  in  tho  air,  ho  had  to  have  a  comprehensive  under¬ 
standing  of  what  his  piano  and  its  equipment  were  designed  to  do  and 
how  it  was  affected  by  unusual  conditions.  To  cito  one  moro  example, 
the  pilot  sometimes  had  to  balanco  the  probabilities  of  icing  or  head 
Winds  at  certain  altitudes  against  the  truo  air  t>pccd  and  rato  of  fuel 
consumption.  Though  ho  received  advice  from  his  crew  members,  tho 
final  decisions  rested  with  him.  Having  tho  proper  knowledge  did 
not  insure  sound  judgment,  but  without  a  certain  minimum  of 
knowledge,  good  judgment  was  impossible. 

In  constructing  printed  tests  to  measuro  flying  information  the 
goal  of  tho  Pilot  Project  was  to  measure  tho  types  of  information 
needed  by  combat  pilots,  irrespective  of  whether  or  not  this  information 
was  covered  in  the  present  curriculum.  Test  items  were  constructed 
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with  the  aid  of  experts  in  each  of  the  relevant  areas  of  information. 
The  items  were  given  a  trial  administration,  distributions  of  responses 
to  each  alternative  and  the  internal  consistency  of  these  responses 
were  determined.  These  data  were  discussed  with  the  experts  and  the 
items  were  revised.  Finally,  the  reliability  of  tho  total  test  and  tho 
reliability  and  intcrcorrclations  of  each  of  its  subsections  wero 
determined. 

Tests  Constructed 

Two  main  tests  were  developed.  One  of  these,  Pilot  Information 
Test,  Form  3,  contained  subsections  dealing  with  flying,  navigation, 
acrocquipincnt,  instrument  flying,  weather,  and  personal  equipment 
(covering  tho  uso  of  oxygen,  etc.).  This  test  required  approximately 
3  hours  total  administration  time  and  had  a  satisfactorily  high  re¬ 
liability  of  0.85,  determined  by  the  Hoyt  method.  The  scoro  on  this 
test,  along  with  other  variables  such  as  flying  grades,  was  used  in 
selecting  tho  best  pilots  to  bo  grouped  with  the  best  navigators, 
bombardiers,  and  flight  engineers,  for  training  as  potential  lead 
crews. 

Two  alternate  150-item  forms  of  a  Pilot  Instrument  Flying  In¬ 
formation  Test  wero  also  developed.  This  test  was  developed  to 
supplement  tho  oral  examination  which  had  been  used  along  with  tho 
flight  check  to  determine  whether  tho  pilot  should  bo  given  an  instru¬ 
ment  card  allowing  him  to  fly  in  instrument  weather.  The  AAF 
Instrument  Flying  Standardization  Board  at  Bryan  recommended 
theso  forms  for  this  use  throughout  tho  Army  Air  Forces,  and  at  tho 
timo  this  report  was  written,  they  had  been  adopted  for  standard  uso 
throughout  tho  Training  Command. 

A  150-item  Pilot  Information  Test  was  also  developed  for  experi¬ 
mental  use  in  the  battery  of  instructor  selection  tests  which  wero 
administered  to  combat  returnees  at  redistribution  stations. 

Recommendations 

As  a  result  of  tho  experience  gained  in  developing  and  administer¬ 
ing  these  tests,  tho  Pilot  Project  recommended  that  a  central  testing 
agency  be  established  for  the  Army  Air  Forces.  This  agency  should 
havo  a  staff  of  experts  on  tests  anti  measurement.  It  should  bo 
charged  with  tho  responsibility  of  supervising  all  printed  tests  used 
in  tho  Army  Air  Forces  and  of  using  such  tests  to  ovnlunto  and 
standardi/.o  tho  efficiency  at  all  levels.  Members  cf  this  agency 
should  visit  stations  to  give  them  technical  ndvico  on  test  construc¬ 
tion  and  to  inspect  their  testing  programs.  Whenever  thcro  is  a 
need  to  test  a  largo  number  of  students  on  tho  same  subjects  at  dif¬ 
ferent  stations,  it  should  consult  relevant  experts  and  uso  its  superior 
central  facilities  for  tho  construction  of  tho  tests  to  distribute  to  tho 
stations.  It  should  conduct  research  studies,  involving  item-  analyz- 


ing,  intcrcorrelating,  nnd  determining  tho  reliability  of  its  tests.  It 
should  also  be  responsible  for  constructing  tests  to  mcasuro  tho 
learning  and  retention  of  subject  material  considered  to  be  especially 
important  for  safe  flying.  Reports  of  periodic  surveys  on  the  pro¬ 
ficiency  of  students,  of  instructors  and  of  operational  pilots  should  bo 
presented  to  the  Office  of  Flying  Safety  and  to  Headquarters  AAF. 
In  time  of  war,  this  agency  should  have  experts  in  the  field  to  assist 
the  various  combat  air  forces  in  making  check-out  tests  especially 
adapte  l  to  the  latest  conditions  in  each  theater  of  operation. 

EVALUATION  AND  SELECTION  OF  FLYING  INSTRUCTORS 
Qualities  of  the  Good  Instructor 

Supervisors,  instructors,  and  students  all  agreed  that  tho  following 
qualities  were  most  important  for  the  good  flying  instructor:  patience 
nnd  self  control;  ability  to  adapt  teaching  methods  to  individual 
students;  flying  ability;  ability  to  analyze  errors;  and  ability  to  express 
himself. 

» 

Work  on  Civilian  Flying  Instructors 

On  tho  basis  of  tho  qualities  which  job  analysis  studies  had  shown 
wero  most  important,  a  lG-itcm  scalo  was  developed  for  supervisors 
to  use  in  rating  tho  civilian  flying  instructors  at  primary  schools. 
Tho  correlation  between  the  total  scores  of  ratings  by  supervisors 
and  assistant  supervisors  was  0.G5,  a  figuro  which  is  too  high  as  an 
estimate  of  reliability  sinco  theso  two  raters  had  probably  influenced 
each  other’s  opinion  of  the  instructor.  Tho  intcrcorrclations  of  the 
items  in  the  scale  ranged  from  0.2G  to  0.90,  indicating  a  considerable 
halo  effect  among  sonic  items  and  a  fair  amount  of  independence  for 
others. 

This  scale  was  used  to  validate  tho  scores  on  a  battery  of  nine 
instructor  selection  tests  nnd  inventories  which  had  been  constructed 
on  tho  basis  of  tho  job  analysis  studies.  Tho  multiplo  correlation 
between  the  score  on  the  16-itcin  scnlo  nnd  tho  battery  of  nino  tests 
was  0.35  for  a  sample  of  433  instructors.  Tho  correlation  of  tho  tests 
with  a  single  over-all  rating  of  teaching  proficiency  was  in  tho  same 
rnngo  as  the  correlation  with  tho  total  scoro  based  on  tho  16  separate 
ratings.  The  valuo  of  securing  ratings  on  separate  items,  howover, 
is  shown  by  the  fact  that  tho  battery  of  tests  correlated  with  the 
teaching  qualities  indicated  by  some  items  on  tho  scale,  whilo  it  left 
thoso  indicated  by  other  items  completely  unmeasured.  Thus  the 
uso  of  the  separate  items  suggested  areas  in  which  further  test  develop¬ 
ment  is  particularly  needed.  Although  theso  tests  wero  designed  to 
predict  teaching  ability,  it  is  interesting  to  noto  that  their  correlation 
with  tho  rating  on  pilot  ability  was  higher  (0.46)  than  their  correla¬ 
tion  with  any  other  item  or  with  tho  total  scoro  on  teacliing  proficiency. 
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Evaluation  and  Selection  of  Military  Flying  Instructors 

Student  rating  scale. — An  18-itcm  scale  was  also  developed  in  order 
to  secure  ratings  on  advanced  and  transition  school  instructors  by 
their  students.  When  each  instructor’s  students  in  a  given  class 
were  divided  into  equal  groups  and  the  ratings  of  these  groups  wero 
correlated  with  each  other,  tho  estimate  of  split-group  reliability 
(corrected  for  the  full  number  of  students)  was  0.75  for  a  samplo  of 
1,395  instructors.  Correlating  the  average  of  tho  ratings  by  students 
in  one  class  with  that  of  students  in  a  different  class  at  least  5  weeks 
later,  yielded  a  test-retest  reliability  of  0.36  on  a  comparablo,  but 
smaller  sample  of  277  instructors.  Both  of  these  figures  aro  based 
on  an  averago  of  3.25  students  per  class  for  each  instructor.  The 
marked  reduction  of  the  size  of  tho  correlation  when  tho  students 
came  from  the  different  classes  was  probably  caused  by  removing 
the  opportunity  for  the  students  in  the  different  groups  to  influence 
each  other.  It  is  also  possiblo  that  the  instructors  changed  somewhat 
during  tho  period  of  five  or  more  weeks  between  tho  two  ratings. 

One  of  the  18  items  on  tho  scale  was  an  over-all  rating.  For 
different  classes  the  tcst-rctest  reliability  of  this  item  was  0.23.  The 
fact  that  the  reliability  of  the  total  score  was  definitely  higher  than 
that  of  the  single  over-all  rating,  indicated  tho  vnluo  of  rating  different 
aspects  of  performance  separately  and  then  adding  up  theso  ratings. 

Tho  intcrcorrclations  among  the  items  of  tho  scale  ranged  from 
0.12  to  0.76,  with  tho  majority  of  them  below  0.40,  indicating  that 
the  different  items  wero  reasonably  independent. 

Tho  correlation  between  tho  total  score  on  tho  student  scalo  and 
tho  supervisor’s  over-all  rating  of  instructor  proficiency  was  only  0.08 
on  a  samplo  of  1,141  instructors  in  advanced  and  transition  schools. 
Tho  Navy  also  found  a  similar  lack  of  relationship  between  students' 
and  supervisors’  ratings  of  flying  instructors. 

Tests  Jailed  to  validate.  —A  battery  of  6  instructor  selection  tests 
and  inventories,  somo  of  them  quite  similar  to  thoso  which  seemed  to 
bo  best  in  the  battery  administered  to  civilian  instructors,  was  vali¬ 
dated  against  tho  total  score  on  tho  student  rating  scale  for  a  samplo 
of  215  instructors,  and  against  supervisor’s  ratings  for  a  samplo  of 
179.  None  of  the  tests  in  this  battery,  nor  the  weighted  score  based 
on  all  of  tho  tests,  showed  any  appreciable  positive  correlation  with 
either  of  theso  two  criteria.  The  fact  that  theso  tests  showed  no 
ability  whatsoever  to  predict  tho  teaching  success  of  combat  returnees, 
whilo  similar  tests  administered  to  tho  civilian  flying  instructors  had 
shown  at  least  a  slight  relationship  to  their  teaching  ability,  indicates 
that  tho  problems  involved  in  devising  and  validating  a  satisfactory 
battery  of  tests  to  select  flying  instructors  are  still  far  from  solved. 

Tests  devised  by  the  Navigator  Project  also  showed  no  ability  to 
predict  on-the-job  measures  of  tho  teaching  performance  of  combat 
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returnees  assigned  to  teach  navigation.  The  Bombardier  Project, 
however,  found  that  similar  tests  had  an  appreciable  ability  to  predict 
teaching  performance  of  bombardier  returnees." 

The  Pilot  Project  found  also  that  preference  expressed  at  a  Redis¬ 
tribution  station  did  not  predict  how  well  a  pilot  returnee  would  like 
instructing  after  he  arrived  at  a  pilot  school  and  started  to  teach 
flying.  Once  he  was  on  the  job,  however,  the  flying  instructor’s  like 
or  dislike  for  his  assignment  was  quite  stable.  The  correlation  be¬ 
tween  two  ratings  of  liking  for  the  job  made  at  least  5  weeks  apart 
was  0.82  for  a  samplo  of  277  instructors. 

Relationship  of  Biographical  Factors  to  Good  Flying  Instruction 

Although  no  relationship  was  found  between  the  test  battery  and 
ratings  of  teaching  proficiency,  interesting  relationships  wero  found 
between  certain  items  of  biographical  and  personal  data  and  the 
students’  and  supervisors'  ratings  of  teaching  proficiency.  Data  were 
secured  on  1,284  instructors.  It  was  found  that  the  older  flying 
instructors  received  reliably  higher  ratings  as  teacher^  than  the 
younger  ones  from  both  their  students  and  their  supervisors.  The 
instructors  with  more  education  and  those  with  a  higher  military 
rank  wero  also  rated  as  reliably  better  by  their  students,  but  not  by 
their  supervisors.  Students  gavo  combat  returnees  better  ratings 
as  instructors  than  nonrcturnccs  but  supervisors  gavo  the  nonre- 
turnccs  a  better  rating  in  both  teaching  and  flying.  Instructors  who 
liked  their  assignments  were  rated  as  better  by  tho  supervisors  but 
not  reliably  so  by  their  students. 

The  relationship  between  length  of  experience  as  a  flying  instructor 
and  the  supervisor’s  rating  on  teaching  contained  a  reversal;  tho  ratings 
became  higher  with  moro  experience  up  to  2  years,  but  wero  somewhat 
lower  beyond  that  point.  Tho  reversal  was  statistically  reliable. 
Tho  total  score  on  the  Student  Rating  Scalo  showed  no  statistically 
reliable  difference  for  instructors  with  different  amounts  of  experience. 
An  analysis  of  each  item  of  this  scale,  however,  showed  that 
tho  instructors  who  had  taught  flying  for  a  longer  period  of  time 
received  reliably  higher  ratings  on  technical  aspects  of  teaching  ability, 
such  ns  analysis  of  errors  and  ability  to  express  themselves,  and 
reliably  lower  ratings  on  personality  items,  such  as  interest  in  the 
student,  patience  and  self  control.  Apparently,  lon|  periods  of 
teaching  flying  improved  tho  instructor’s  technical  ability  but  spoiled 
his  patienco  and  personality. 

Recommendations 

On  tho  basis  of  the  cxpcricnco  gained  in  this  research,  a  number  of 
recommendations  aro  mado.  It  is  believed  that  teaching  cannot  be 

•  8m  noporn  No.  9  Mid  10  In  this  series,  Psychological  Research  on  Bombardier  Training  and  Psycho¬ 
logical  Uescarch  on  Navigator  Training,  respectively. 
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learned  by  lectures  and  demonstrations  alone,  without  supervised 
practice,  any  more  than  flying  can.  Therefore,  if  Central  Instructors 
Schools  arc  going  to  emphasize  teacher  training  in  addition  to  stand¬ 
ardized  flying,  it  is  believed  that  it.  will  bo  necessary  for  them  to 
contain  an  experimental  school  in  which  the  student  instructor  can 
practice  teaching  cadets  under  expert  supervision.  Research  should 
bo  devoted  to  developing  special  techniques  for  grading  tho  student 
instructor  on  his  practice  teaching  so  that  elimination  from  Central 
Instructors  School  may  bo  based  on  teaching  ns  well  as  flying  ability. 
Gradej  on  teaching  ability  at  the  Central  Instructors  School  should 
bo  validated  against  subsequent  performance  in  tho  pilot-training 
school  to  which  tho  instructor  is  assigned. 

It  is  believed  that  it  would  be  lseful  to  use  the  Student  (and  perhaps 
also  tho  Supervisor)  Rating  Scale  to  allow  tho  instructors  to  sco  them¬ 
selves  as  others  sco  them. 

In  order  to  make  any  fundamental  improvements  in  tho  supervisor’s 
rating  of  instructor  proficiency,  it  will  probably  bo  necessary  to  make 
systematic  attempts  to  sco  that  ho  gets  a  better  opportunity  to  observe 
his  instructors  in  tho  actual  teaching  situation.  In  tho  reduced  peace¬ 
time  training  program,  it  should  be  possible  for  two-engino  supervisors 
to  ride  with  their  instructors  and  students  moro  frequently  and  for 
single-engine  supervisors  to  sample  instruction  through  uso  of  air-to- 
ground  radio  or  magnetic  wire  recorders. 

Sinco  tho  ultimato  test  of  tho  instructor  is  tho  quality  of  tho  students 
ho  produces,  it  will  be  highly  desirable  to  validato  and  item  analyze 
both  tho  Student  and  the  Supervisor  Rating  Seales  against  tlio  quality 
of  students  produced  under  controlled  conditions.  It  is  behoved  that 
improved  Student  ond  Supervisor  Rating  Seales  will  havo  tho  following 
useful  functions:  (1)  To  improve  instructors  on  tho  job  by  letting  them 
know  their  weak  points;  (2)  to  validate  instructor  selection  tests  ond 
Central  Instructors  School  grades;  (3)  to  study  tho  way  in  which  fac¬ 
tors,  such  as  length  of  assignment  ns  instructor  and  other  biographical 
data,  arc  related  to  teaching  proficiency;  and  (4)  to  moasuro  tho  results 
of  training  experiments  conducted  to  cvnluato  the  effects  6f  procedures, 
such  as  adding  variety  to  the  lifo  of  the  flying  instructor  by  temporarily 
rotating  him  to  other  assignments. 

TRAINING  EXPERIMENTS 

Planning  tho  best  program  of  pilot  training  involves  many  problems 
which  can  bo  solved  conclusively  only  by  training  experiments.  Tho 
moro  scientifically  these  experiments  arc  designed,  tho  easier  it  is  to  get 
accurato,  decisive  results. 

While  tho  essential  idea  behind  tho  experimental  approach  is  trying 
something  out  to  sco  how  it  works,  a  truly  scientific  experiment  in¬ 
volves  far  moro  than  this.  Its  great  power  lies  in  tho  fact  that  condi¬ 
tions  are  arranged  so  that  tho  effects  of  disturbing  factors  arc  controlled 
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or  cancelled  out  and  the  results  arc  decisive  and  unambiguous.  It  is 
also  necessary  to  devise  some  way  to  measure  these  results  so  that  they 
can  he  stated  clearly  and  interpreted  in  the  same  way  by  everyone. 

It  is  believed  that  one  of  the  more  useful  functions  of  psychologically 
trained  personnel  working  with  the  Army  Air  Forces  should  ultimately 
bo  to  serve  as  consultants  on  the  scientific  design  of  experiments  for 
evaluating  training  methods  and  devices.  This  was  not  possible  dur¬ 
ing  the  war  because  of  the  concentration  of  psychological  personnel  on 
tasks  more  immediately  related  to  the  original  classification  testing 
program.  Two  minor  experiments,  however,  and  one  semiexperi- 
incntul  study,  were  undertaken  in  the  area  of  pilot  training.  These 
arc  briefly  described  to  illustrate  the  experimental  approach  to  train¬ 
ing  problems  even  though,  because  of  their  incidental  nature,  it  was 
not  possible  to  control  conditions  in  such  a  way  as  to  secure  ideal  ex¬ 
perimental  design. 

One  of  these  experiments  indicated  that  students  who  had  received 
part  of  their  basic  flying  training  on  a  two-engine  airplane  performed 
better  in  advanced  two-engine  training  than  those  who  had  received 
all  of  their  basic  training  on  a  single-engine  airplane. 

Tho  other  experiment  compared  the  value  of  skcct  shooting  as  a 
training  aid  under  two  conditions:  when  tho  conventional  shotgun 
sight  was  used,  and  when  a  new  optical  sight  was  used.  Tho  optical 
sight  had  the  advantage  of  simulating  tho  sight  pictures  which  the 
students  would  later  employ  in  fixed  gunnery  missions.  It  was  found 
that  thp  students  trained  on  a  skcct  gun  equipped  with  an  optical 
sight  made  reliably  better  scores  in  subsequent  air-to-air  firing  than 
those  who  received  their  skcct  training  with  tho  conventional  type 
of  shotgun. 

Tho  fact  that  the  objective  measures  of  advanced  two-engine 
flying  taken  during  a  temporary  trail  ing  freeze  happened  to  coincide 
with  a  change  of  airplanes  in  some  schools  enabled  a  scmicxpcrimcntal 
comparison  to  be  mado.  Bccauso  tho  different  types  of  training  com¬ 
pared  were  ones  which  happened  to  occur  for  other  reasons  instead  of 
being  deliberately  designed  for  an  experimental  purpose,  all  of  the 
conditions  were  not  controlled  and  tho  results  must  bo  accepted  with 
reservation.  It  was  found  that  tho  students  with  a  total  of  10  hours 
of  two-engine  training,  all  of  which  was  in  the  higher-powered  TB-25, 
performed  better  on  that  airplano  than  students  with  a  total  of  15 
hours  of  two-engino  training,  10  of  which  was  on  tho  lower-powered 
AT- 10  or  UC-78. 

Tho  results  of  the  three  studies  which  have  just  been  described 
deal  with  tho  problem  of  transfer  of  training.  They  all  follow  the 
well-known  principle  that  more  transfer  occurs  when  the  two  situa¬ 
tions  aro  moro  similar. 

Tho  problem  of  transfer  of  training  is  involved  throughout  the 
pilot  training  program.  Whenever  a  student  is  trained  :n  one  eitua- 
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tion  with  the  hope  that  it  will  hasten  his  learning  in  another,  thcro 
arc  three  possibilities:  (1)  The  two  situations  may  be  so  different  that 
little  or  no  transfer  occurs;  (2)  the  habits  learned  in  the  first  situation 
may  be  sufficiently  different  from  those  acquired  in  the  second  so 
that  they  will  interfere  with  learning  and  causo  negativo  transfer;. 
(3)  the  habits  learned  in  the  first  situation  may  he  useful  in  the  second 
and  produce  positive  transfer.  Whether  positive  or  negativo  transfer 
will  occur  may  depend  on  the  amount  of  training  given  in  tho  first 
situation;  one  amount  of  training  may  be  beneficial,  another  amount 
may  be  wasted  or  even  harmful.  While  the  results  of  experiments 
which  have  been  performed  in  psychological  laboratories  on  other 
types  of  learning  cannot  predict  exactly  what  will  happen  in  a  complex 
situation  like  that  found  in  flying  training,  they  can  suggest  what  to 
look  for  and  how  to  design  a  scries  of  training  experiments  for  deciding 
what  kinds  and  amounts  of  training  at  each  level  will  bo  most  efficient 
in  tho  long  run. 

The  factor  of  transfer  of  training  is  only  ono  cxamplo  of  the  var¬ 
iables  which  need  investigation  by  the  experimental  method.  Somo 
other  examples  are  determining  the  most  efficient  distribution  of 
practico  (or  in  other  words,  just  how  much  material  may  bo  concen¬ 
trated  in  a  short  period  of  timo  without  defeating  tho  purpose  of 
training),  and  finding  tho  optimum  spacing  of  review  to  counteract 
forgetting.  Training  aids  and  equipment,  such  ns  training  films  and 
the  Link  Trainer,  also  should  bo  evaluated  by  tho  experimental 
method.  As  tho  Training  Command  changes  over  to  a  peacetime 
status,  ono  of  its  important  functions  should  be  research  to  nssuro 
this  nation  leadership  in  training  methods  and  equipment. 

,  CONDITIONS  NECESSARY  FOR  EFFECTIVE  RESEARCH 

On  the  basis  of  their  army  nnd  civilian  research  experience,  tho 
members  of  tho  Psychological  Research  Project  (Pilot)  havo  outlined 
tho  following  conditions  as  essential  to  efficient  research.  Though 
many  of  these  conditions  aro  quite  apparent,  they  aro  all  listed  bccauso 
experience  has  shown  that  creative  scientific  work  becomes  inefficient 
whenever  any  one  of  them  is  not  fulfilled.** 

Personnel. — Scientific  research  requires  specially  trained,  expe¬ 
rienced  personnel.  It  demands  originality  and  intelligence  in  nddition 
to  approximately  3  years  of  postgraduate  training  in  scientific  prin¬ 
ciples  and  techniques  after  th  completion  of  tho  ordinary  4-ycar 
collcgo  course.  After  this  trail  lg,  skill  in  planning  nnd  supervising 
research  is  acquired  through  expc nee.  Furthermore,  in  working  in 
an  area  such  as  pilot  training  w  uich  has  its  own  complex  technical 
aspects,  tho  investigator  needs  a  thorough  understanding  of  tho  field 
to  which  he  is  applying  his  scientific  techniques.  It  is  highly  desirablo, 

»  Be*  also  the  Mdlon  on  "Conditions  ol  Research"  In  chapter  l  of  this  report. 
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therefore,  that  psychologists  working  on  problems  of  pilot  training 
receive  systematic  flying  training,  or  that  carefully  selected  pilots  who 
are  interested  in  training  research  bo  sent  to  universities  for  enough 
graduate  training  to  receive  the  Ph.  D.  degree  in  psychology. 

Since  scientists  reccivo  stimulation  from  tho  discussions  and  criti¬ 
cisms  of  their  colleagues,  it  is  desirable  to  have  a  number  of  them 
working  at  the  same  placo  and  to  bring  larger  groups  together  for 
periodic  conferences.  In  order  to  allow  them  to  keep  up  with  the 
latest  technical  developments  in  their  field,  attendance  at  scientific 
meetings  and  visits  to  various  universities  should  bo  facilitated. 

As  increasing  numbers  of  highly  trained  specialists  are  employed 
by  tho  army,  each  typo  of  specifically  military  training  and  duty 
should  bo  examined  to  determine  whether  or  not  it  is  efficient  to 
hnvo  tho  specialized  personnel  spend  their  time  on  it. 

Sinco  tho  Military  Occupational  Specialty  number  (MOS)  plays 
such  an  important  role  in  tho  administration  of  army  personnel 
policies,  research  workers  should  hnvo  different  MOS  numbers  ade¬ 
quately  reflecting  their  specialization,  oven  though  tho  number  of 
individuals  involved  may  bo  relatively  small  in  comparison  with  the 
rest  of  tho  army  categories. 

Chain  of  command. — Sinco  research  is  such  a  highly  technical  spe¬ 
cialty,  it  is  just  as  necessary  to  havo  tho  chain  of  command  for 
research  filled  by  officers  with  rigorous  training  and  experience  in 
this  specialty  ns  it  is  to  havo  a  pilot  ns  tho  Director  of  Training  of  a 
flying  school.  Tho  technical  direction  of  research,  and  also  control 
over  tho  assignment,  transfer,  and  promotion  of  tho  personnel,  should 
bo  exercised  by  men  with  tho  special  training  and  experience  neces¬ 
sary  to  understand  tho  technical  details  of  research  operations. 

Procurement. — Research  frequently  has  sudden  requirements  for 
unusual  supplies  or  services  which  cannot  bo  procured  by  routine 
army  procedures.  For  example,  in  designing  and  constructing  an 
apparatus  to  accomplish  something  which  has  never  been  done  be- 
foro,  tho  scientist  may  find  that  certain  parts  do  not  work  satisfac¬ 
torily  so  that  they  havo  to  bo  unexpectedly  redesigned.  Ho  cannot 
anticipate  his  exact  needs  months  in  advance  in  the  same  way  that 
a  mess  officer  can  count  on  a  special  dinner  for  Thanksgiving  Day. 
When  ho  is  making  arrangements  for  a  firm  to  develop  something 
completely  now,  ho  cannot  always  submit  complete  plans  in  advance 
to  threo  bidders.  Ho  needs  special  procurement  authorities  which 
are  far  more  flcxiblo  than  thoso  required  for  routino  army  operations. 
In  timo  of  war,  ho  needs  high  priorities  in  order  quickly  to  procure 
special  equipment.  Expediting  tho  procurement  of  a  relatively  small 
amount  of  crucial  research  equipment  may  pay  big  dividends  in  the 
long  run. 

Authority  to  establish  experimental  conditions. — In  order  to  deter¬ 
mine  tho  most  efficient  method  of  training,  it  is  frequently  necessary 
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to  introduce  controlled  changes  into  training  or  to  be  nblo  to  procuro 
subjects  to  serve  in  special  experiments.  Tho  investigator  must  be 
able  to  secure  authority  to  establish  experimental  groups.  Although 
setting  up  a  scientific  experiment  with  tho  proper  controls  may  some¬ 
times  bo  a  temporary  inconvenience,  it  is  much  moro  efficient  in  the 
long  run  than  just  trying  something  out  to  sco  what  happens. 

Liaison. — A  research  program  needs  representatives  at  all  echelons. 
Representation  at  the  highest  level  is  especially  important  to  keep  tho 
program  informed  of  problems  that  arc  relevant  in  tho  light  of  tho 
planning  which  is  being  conducted  there,  and  to  havo  its  results 
presented  where  they  can  be  most  useful  in  determining  matters  of 
general  policy.  Most  of  the  actual  research,  however,  must  bo  con¬ 
ducted  in  direct  contact  with  the  practical  situation  at  the  lower 
operational  levels.  In  order  to  secure  the  rapid  exclmngo  of  informa¬ 
tion  which  is  frequently  essential  to  efficient  research,  direct  com¬ 
munication  on  technical  matters  is  needed  between  representatives  at 
different  levels  and  in  different  commands.  Since  many  types  of 
information  can  only  be  secured  first-hand,  arrangements  must  bo  made 
to  facilitate  tho  travel  of  research  personnel  to  tho  sources  of  this 
information. 

Relationship  to  operations.- — The  mission  of  a  research  organization 
should  be  to  gather  facts  and  to  develop  and  evaluate  new  procedures. 
It  should  present  recommendations  and  evidence  to  those  responsible 
for  determining  policies  and  procedures  but  should  not  havo  any  direct 
command  responsibility  for  operations.  It  may  bo  desirable  for 
research  pcrsonrcl  to  assist  in  training  operational  personnel  in  now 
procedures  and  to  monitor  these  new  procedures  for  a  period  of  time, 
but  they  should  not  be  directly  responsible  for  tho  operations.  A 
separation  of  function  is  desirable  in  order  to  help  the  research  person¬ 
nel  to  preserve  their  independence  and  objectivity,  and  to  allow  each 
typo  of  personnel  (research  and  operating)  to  perform  tho  functions 
for  which  they  havo  special  training  and  experience. 

Another  reason  for  keeping  tho  two  functions  administratively 
separato  (although  tho  two  types  of  personnel  should  work  closely 
together)  is  to  prevent  the  natural  tendency  for  operations  to  swallow 
research.  If  tho  two  aro  together,  there  is  a  natural  tendency  to  mcot 
various  emergencies  by  cutting  back  research  in  order  to  maintain 
operations,  since  tho  effects  of  reducing  operations  aro  so  immediately 
apparent  whilo  the  more  serious  consequences  of  reducing  research 
(like  thoso  of  grinding  up  seed  corn  to  mako  bread)  do  not  show  up 
till  later. 

A.  Research  Corps. — It  is  believed  that  the  special  conditions  essen¬ 
tial  to  efficient  research  can  be  achieved  most  economically  by  bringing 
all  different  types  of  research  personnel  together  in  a  Research  Corps. 
This  should  result  in  economy  of  administration,  making  it  easier  to 
establish  a  chain  of  command  with  specially  trained  research  personnel 
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at  all  echelons.  It  should  also  effect  &  desirable  coordination  of  the 
work  of  different  specialists.  For  example,  in  developing  a  new  piece 
of  equipment,  the  question  of  whether  its  design  is  well  adapted  to 
human  perceptual  and  motor  abilities  should  bo  investigated  at  the 
samo  time  that  the  engineering  aspects  of  its  development  aro  being 
considered.  Furthermore,  thoso  who  will  have  to  work  on  tho  special 
problems  of  selecting  and  training  tho  personnel  to  operate  it  should 
be  kept  informed  on  tho  significant  details  of  its  development.  It  is 
believed  that  psychological  research  on  pilot  training  can  operate 
most  efficiently  if  it  is  a  part  of  a  Research  Corps. 
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APPENDIX  TO  CHAPTER  FIVE _ 

Studies  of  Subjective  Measures 
of  Flying  Proficiency 
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Table  A5.1. — Correlation  of  categorized  comments  from  the  daily  grade  slip  tcith 

primary  pass-fail 

Class  44-K,  Jones  Field  (N,  =  59,  ;V.  =  33,  P,=*.641) 


Category  > 

M. 

M. 

Motor  technique  • . 

0.15 

.30 

1. 10 

asr 

neodwork...! .  .  . 

1.65 

.84 

Perception . 

.  10 

.61 

.73 

Emotional  difficulties . 

.43 

1. 31 

KJ 

.u 

i  For  this  preliminary  sample  comments  wore  grouped  tint  Into  81  subcntegorles.  Sinn  only  those  sub* 
i  categories  were  used  hero  which  were  positively  related  to  pass-fall  (I.  e.,  ellmlnco  group  receive*!  more  com¬ 

ments  than  prnduntes)  the  absolute  site  of  these  correlations  Is  spuriously  high,  but  the  relatlvs  comparisons 
I  among  categories  are  probably  meaningful. 

|  *  Correlation  coefficients  have  been  changed  In  sign  to  Indicate  positive  SLSSoclatlon  of  good  performance. 


Table  A5.2. — Intcreorrelations  of  categorized  comments  from  the  daily  grade  slip 


Dosed  on  92  Students  in  Class  44-K,  Jones  Field 


Category 


1.  Motor  technique ' _ 

3.  Perception . 

3.  Ilcadwork . 

4.  Emotional  difficulties 


M 

1 

3 

3 

« 

o.so 

a  n3 

a  48 

a  j« 

0.04 

.40 

.44 

a  48 

MRHR 

.47 

.30 

1.03 

.03 

.M 

HP 

.43 

.00 

.84 

.04 

KJ 

.43 

■  Correlation  coefficients  have  been  changed  In  sign  to  indicate  association  of  good  performance  positively. 
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Table  A5.3. — Inter  correlationa  of  caltgoriet  of  grade  elip  comment t,  classification  tes Is,  pilot  etanine  and  primary  check-ride  grade 


$  |  a  |  235S22^1«?;as8S358SaJ?53asa8J8  j 


Table  A5.4. — Intercorrelations  of  items  on  rating  scale  for  aviation  cadets  ( Form  A-Pilot )  grouped  by  cluster  patterns 
Based  on  369  students  in  class  42-K  rated  between  the  8th  and  10th  hours  of  primary  training 
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APPENDIX  TO  CIIAPTER  SIX 


Objective  Measures  of  Flying  Skill 
For  the  Primary  Level 
of  Pilot  Training 


For  the  item-analysis  studies,  I,  II,  III,  IV,  and  V,  each  of  the  tables 
of  results  (tables  A6.1  through  AG.13)  is  divided  into  sections  A,  B, 
and  C.  Section  A  shows  the  summary  data  and  contains  tho  biserial 
correlations  of  tho  measuro  scores  with  graduation  elimination  from 
primary  school;  tho  point-biserial  correlation  with  scores  of  tho  upper 
group  (moro  hours  of  flying  training)  and  tho  lower  group  (fewer  hours 
of  flying  training)  on  tho  first  day  of  testing;  similar  point-biserial 
correlations  for  tho  same  groups  on  tho  second  day  of  testing;  and  tho 
test-rctcst  reliability,  which  is  a  combination  of  test-rctcst  reliabili¬ 
ties  for  the  upper  and  lower  groups  by  tho  z-transformation  tcchniquo. 

Section  B  shows  tho  basic  data  for  tho  biscrial  correlations  with 
graduation  and  elimination  from  Primnry.  Section  C  shows  tho  bnsio 
data  for  tho  point-biserial  correlations  on  tho  two  days  of  testing  and 
for  tho  test-rctcst  reliabilities  of  upper  and  lower  groups. 

Beginning  with  table  AG.  14,  tho  necessary  data  for  studies  VI  and 
VII  aro  shown. 

In  all  of  tho  tables  tho  sign  of  the  coefficients  has  been  adjusted  so 
that  goodness  of  performance  in  both  variables  is  indicated  by  a  posi¬ 
tive  sign. 

The  asterisk  on  the  coefficients  in  the  summary  data  tables  indicato 
tho  chances  in  100  of  obtaining  positivo  coefficients  ns  largo  as  tlicso, 
if  thero  were  no  relationship  between  the  variables.  This  is  dono  ac¬ 
cording  to  tho  following  system: 

No  ssterlsk-More  than  10  percent. 

•- 10  percent. 

••-7.5  percent. 

•••-0.5  percent. 

Tho  footnotes  for  all  of  tho  tables  aro  ns  follows; 

•  Lower  score  Is  better  score. 

•  Corrected  for  broswl  categories  used  In  the  largc-sesle  study  of  tho  effects  of  additional  training  on  dying 
skill,  tho  complete  report  of  which  Is  In  chapter  10. 

•  Tetrachorlc  correlation. 

•  Coded  score. 
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Table  A6.1 — Take-off,  climb,  andfirtt  turn 
Section  A:  Summary  data 


Validity 

Reliability 

Code  (Study,  maneuver  and  measure) 

I 

fsu 

grad.— 

ellm. 

3 

r,tu  U. 
versus  L. 
first 
day 

3 

r*tu  U. 
versus  L. 
second 

day 

4 

tn  flrst 
versua 
second 
day 

VI  M  Smooth  application  of  throttle  In  tike-off  . . 

•••a  45 

1 11* K 2  (1  round  control  during  43  m.  n.  h.  tail  high  run: 
kcnl  1  ine  under  left  wine  until  take-off  . 

•*\SI 

a  13 

-an 

•♦•.27 

Ill  Si?  (Iround  control  dfurinic  acceleration  to  55  m.  p.  h. 
and  deceleration  to  full  stop:  kept  line  under  wins 
throughout  ...  .  ...  . 

-.IT 

.03 

.00 

MS 

VI-A2.  Deviation  of  plane  from  straight  path  during  take- 
oil  roll  .  . .  . . . 

••♦.48 

•••.os 

II-A1.  A/S  when  plane  leaves  ground;  corrected  for  Instru* 
ment  error  (instruments covered) .  ...  . .  . . 

.13 

-.00 

.11 

III-At .  A/S  when  piano  leaves  ground;  corrected  for  Instru- 
ment  error. . . .  . .  .  .  .  . . . . 

.01 

•••.30 

*.14 

••  23 

IV-A3.  A/S  reading  when  plane  leaves  ground . 

.03 

••*.08 

VI  At.  Instructor's  rnllng'of  plane  fly  off . 

**•.75 

••*.53 

I-A2.  A/S  range  In  climb  io  first  turn . 

MS 

mmm 

.13 

1I-A2.  A/S  roiigo  in  climb  to  first  tum  (instruments  cov¬ 
ered)  . 

••Ml 

.04 

.07 

1II-A2.  A/S  rarge  in  climb  to  first  tum . . 

mmssi 

.03 

-.03 

-.01 

VI-AS.  A/S  range  In  climb  to  first  turn . 

••*.80 

VI-A8.  l'lnnc  drift  during  c'.lmb . . . . . ...... 

:: 

•••.68 

II-AJ.  Altitude  range  during  first  tum  (Instruments  cov¬ 
ered)  . . . 

•*.37 

.01 

.00 

1 1 1- A3.  Altitudo  ranee  during  Orst  tum . . 

*.20 

*.17 

•••33 

M4 

VI-A7.  Altitude  deviation  from  300  feet  during  first  turn.. 
I1I-A4.  Hall-bank  deviation  during  Orst  turn _ ... _ 

••*.77 

•••.08 

.05 

*.lt 

.03 

-.13 

Section  B:  Data  for  ru»  graduation-elimination 
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Code 


Table  A6.1 — Take-off,  climb,  and  first  (urn — Continued 
Section  C:  Data  tor  r,tn,  And  for  reliability  rn 


I1IK2. 
IIIM2 
IIAI.. 
Ill  A 1 . 
LA2... 
IIA2.. 
IIIA2. 
HAS.. 
Ill  A3. 
IIIA4. 


Upper  or  lower 


!  Upper. 
Lower. 
Upper. 
I-ower. 
Upper. 
Lower. 
Upper, 
tower. 
Upper, 
tower. 
Upper, 
tower. 
Upper. 
I/ower. 
Upper, 
l^wcr 
Upper. 
Lower. 


First  dsjr 

Second  day 

ru 

r*ku 

N 

M. 

SD 

r,n. 

AT 

M. 

SD 

}0.12 

46 

0  40 

-0.11 

/  48 

0  60 

U.  49 

a  44 

45 

.47 

.50 

1  45 

.  4fl 

■r: 

E 

46 

1.07 

.62 

.00 

K. 

1.13 

.90 

.n 

45 

1  C4 

.82 

4.3 

1.1.3 

.91 

.21 

•'1 

46 

5  4  24 

-.00 

46 

5  A  87 

4.92 

■  .i 

43 

5.23 

4.31 

4.3 

A  12 

181 

.21 

.30 

46 

us 

3.70 

.14 

46 

EXSD 

19ft 

.40 

45 

A  22 

3.97 

45 

4.78 

1.0 

Ktj! 

.01 

41 

5  A  22 

3. 95 

41 

5  A  71 

181 

.23 

.36 

A  32 

3.  AS 

36 

A  18 

133 

.31 

f 

5  A  22 

3.12 

.01 

'KZ 

ITT 

193 

.16 

\  « 

7.74 

4.  A3 

Ml. 

■TT 

151 

-.03 

.03 

/  48 

5  A  15 

4.62 

-.02 

/  48 

Ei. 

4.33 

-.15 

l  4i 

A  44 

4.  57 

1  45 

A  11 

A  75 

.15 

.27 

i 

mn 

22  3 

.01 

l 

521.8 

nn 

.12 

l  42 

3A0 

30.9 

42 

224 

23.2 

.07 

.17 

r 

*23  81 

l  4. 

.33 

1 

/  46 

5  IS.  6.5 

14. 96 

HJ 

l  45 

32. 45 

2A  A3 

\W2 

20.33 

.31 

.14 

X 

2  NO 

.45 

■ 

i 

2  76 

.52 

-.01 

144 

104 

.71 

\  41 

173 

.49 

-.22 

N 


4ft 

45 

4ft 

45 

4A 

45 

40 
45 

41 
3s 
40 

42 
40 
45 
44 
42| 
4ft 

m 

4ft 

44 


Rrlla. 

bllltjr 


r.» 

test- 

retest 

Komb. 


0. 27 
.U 
.13 
.23 
.13 
.07 
-.01 
.00 
.14 
-.12 


b  Lower  score  b  better  soon. 


Table  A6.2. — Low-altitude  maneuvers:  ( S-turns :  Rectangular  course;  altitude,  A/S, 

RPM  estimation) 


Section  A:  Summary  data 


Validity 

Reliability 

Code  (Studr.  maneuver,  end  measure) 

1 

rat. 

grad.— 

eltm. 

9 

7»5U  U. 

versus  L. 
first 
day 

s 

r.tu  U. 
versus  L. 
second 
day 

4 

Jit 

first 

versus 

teeond 

day 

111*01.  8-tums:  Altitude  r»nr  j  In  4  loops . 

•0.34 

••a  22 

••0. 2J 

•••a  49 

111-02.  8-turns:  Drift  corrections;  sum  of  time  for  2 down¬ 
wind  loops  (1-3),  minus  sum  of  time  for  2  upwind  loops 

III-&3.  8-turns:  tlank  changed  through  level  over  road  et 
end  of  first  loop . 

••♦.41 

-.00 

.02 

•••.99 

•28 

.00 

.11 

.00 

III-04.  8-tums:  Bonk  changed  through  level  over  road  at 
end  of  second  loop . 

.15 

-.04 

.09 

-.0# 

111-05.  8-tums:  Bank  changed  through  level  over  road  at 
end  of  third  loop . 

.00 

.06 

*.  10 

.01 

III-06.  8-tums:  Bank  changer!  through  level  over  road  at 
end  of  fourth  loop . 

.  II 

.03 

MO 

-.13 

Ill-Ill.  Rectangular  course:  Altitude  range  on  4  legs  of 
rectangular  course . 

•.35 

•••.  St 

*.  14 

10 

III-I12.  Rectangular  course:  Drift  correction;  turn  onto 

-.10 

.12 

-.00 

1 1 1-213.  Rectangular  course:  Drift  correction;  turn  onto 

■ 

-.03 

•14 

M0 

II2-II4.  Rectangular  course:  Drift  correction;  turn  onto 

HUB 

.04 

.01 

.07 

1II-1I5.  Rectangular  course-  Drift  correction:  turn  onto 
fourth  leg  correct  or  proper  correction  made  (r»u  for  sum 
of  all  4  drift  correction  measures)  . 

.18 

-.00 

••*.20 

•••.30 

H-FI.  Instruments  covered:  Placed  plane  at  500-foot  altl- 

.07 

.00 

•.  17 

1I-F1  Instruments  covered:  6ct  piano  at  cruising  A/8; 

.00 

-.07 

-.00 

H-F3.  Instruments  covered:  Bet  piano  at  'nilslng  r.  p.  m.: 

.04 

-.04 

MS 

1I-F4.  Instruments' covered:  Altitude  range  during  M  sec¬ 
onds  straight  and  level  at  500-foot  altitude . 

-.07 

.10 

.00 

i 
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Taolu  A6.2. — Low-altitude  maneuver »:  (S-turm:  Rectangular  course;  altitude,  A  IS, 

RPM  estimation — Continued 


Section  D:  Data  for  r^i,,  graduation-elimination 


Code 

tf, 

Pi 

A  f. 

M, 

SD, 

r»b 

mot .  ...  .  ... 

41 

68 

*206.43 

298.40 

161.00 

a  M 

1 1 102 . . . 

42 

60 

*  14. 07 

19.02 

8.83 

.41 

11103 . . . . . 

41 

71 

1.38 

1. 17 

.70 

.28 

111(14  . . 

41 

71 

1.31 

1.23 

.60 

.18 

IIIOJ . 

38 

71 

1.37 

1.27 

.62 

.00 

1110(1  .  . 

37 

70 

1.40 

1.30 

.60 

.11 

mm.  .  . . . 

38 

66 

*242  60 

341.34 

167.23 

.38 

Ill  112,  3,  4,  6  . .  . . 

41 

71 

12. 21 

11.00 

4.62 

.16 

*  Lower  score  b  better  score. 


Section  C:  Data  for  r,bi«  and  for  reliability  ru 


Code 

Upper  or 
lower 

First  day 

Second  day 

rn 

Relia¬ 
bility 
test- 
re  lest 
x-corab. 

r,n. 

N 

Mi 

SD 

r»*b 

N 

Mi 

SD 

inai . 

11102 . 

1 1 103 . 

IIIQ4 . 

11103  . 

IIIOO  ... 

Hint . 

1 1 1 11 2 . 

Ill  113 . 

hum . 

1I1II8 . 

ii n  . . 

1 1 K2 . 

I1K3 . 

1IK4 . . 

fUpper . 

tower . 

UPP" . 

tower......... 

Upper . 

tower . 

Upper . 

tower. . 

Upper . 

tower  . 

Upper  . 

tower  . 

Upper . 

tower.  - 

/Upper  . 

\  tower  . 

1  tipper . 

l  Lower . 

/Upper  . 

itower . . 

/Upper . 

1  tower _ 

/Upi>er . 

itower . 

/Up|>er . 

\  tower . 

/Upper . 

\  tower . 

/Upper . 

\tower . 

0.22 

.09 

.08 

-.04 

.06 

.03 

.31 

19 

-.03 

.01 

-.09 

.07 

.06 

.01 

-.07 

40 

44 

40 

,  <S 

46 

44 

45 

.  43 

46 

« 

46 

43 
46 

44 
46 
44 
46 
44 
46 
43 
46 
43 
46 
38 
46 

,  43 

9  85. 00 
113.41 
7.  48 
8.33 
.67 
.69 
.73 
.77 
.74 
.68 
.83 
.82 
*91.63 
1 19. 76 
1.  11 
1.44 
1.22 
i.  27 
1.  4b 
1,  36 
1.30 
1.50 
*13. 39 
15.61 
*3.91 
4.42 
*8.74 
6. 16 
*3.91 
6.  14 

39.  43 
80.50 

4.38 
3.42 

.47 

.49 

.44 

.42 

.44 

.47 

.37 

.64 

60.34 

114.03 

.91 

.78 

1.00 

.oo 

I.0S 

1.19 

.93 

1.16 

14.88 

18.11 

3.60 

4.97 

4.83 

6.39 
7.15 
3.09 

0.23 

.02 

.11 

.02 

.16 

.16 

.14 

.12 

.14 

.01 

.28 

.06 

-.07 

-.04 

.10 

40 
44 
46 

43 
46 

44 
43 

43 
46 

41 

42 

39 

43 
41 
4tt 

45 

46 

44 
46 
41 
46 

44 
46 
43 
46 
43 

40 
38 
40 

l  43 

*84.90 
119.  77 
7.80 
7.60 
.76 
.68 
.36 
.63 
.78 
.63 
.79 
.64 
*106.98 
127.80 
1.67 
1.47 
1.67 
1.41 
1.87 
l.bl 
2  13 
1.39 
*10  48 
11.74 
*4.78 
4. 19 
*6.09 
8.66 
4. 26 
6.03 

36.74 

88.89 
6.34 
677 

.41 

.47 

.60 

.80 

.41 

.48 

.41 

.48 

63.33 

87.89 
.98 
.78 
.08 
.86 

1.01 
1.00 
.02 
.06 
0.07 
11.41 
4.64 
3.40 
S.  33 
4.38 
2  46 
4.06 

-006 
.72 
.32 
.23 
•-.04 
•.03 
•.06 
•-.12 
•.30 
•-.32 
-  ».1S 
•-.42 
-.07 
.27 
-.11 
-.04 
.18 
.17 
.13 
.00 
36 
.22 
.28 
-.05 
.09 
-.20 
.11 
.19 
.01 
.07 

043 

.29 

•00 

•-.09 

•.01 

•-.13 

.10 

-.09 

.18 

.07 

.30 

.17 

-.03 

.IS 

.OS 

*  lower  score  Is  better  score. 

•  Tctrncborlc  correlation. 


1 

i 

f 
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Table  A6.3. — Accuracy  landing:  traffic  pattern  and  approach 


Section  A:  Summary  data 


Code  (Study,  maneuver  and  measure) 


VI-BI.  Trnfllc  pattern:  Enters  downwind  lee  In  middle 
third . .. . .. . 

I- 01.  Traffic  pattern:  Altitude  range  from  pattern  entry 

until  throttle  Is  cut .  . 

II- M1.  Traffic  pattern:  Attitude  range  from  pattern  entry 

until  throttle  Is  cut  . • . . 

IU-N'l.  Traffic  pattern:  Altitude  range  from  pattern  entry 
until  throttle  is  cut . 

VI-B2.  Traffic  pattern:  Maximum  deviation  from  altitude 
of  500  feet  In  pattern  from  entry  until  throttle  Is  cut _ 

V1-B4.  Traffic  pattern:  Turn  onto  approach  leg  started 
300  feet  or  above . 

VI-U5.  Final  approach:  After  throttle  closed,  more  power 
not  necessary,  or  added  os  required . 

I- 02.  Final  appronch:  A/S  range  from  completion  of  last 

turn  until  student  begins  to  break  glide . 

If- M2.  Final  approach:  A/S  range  from  beginning  of  last 
turn  until  student  begins  to  break  glide . — 

II- Xt.  Final  approach:  A/3  range  from  beginning  of  last 

turn  until  student  begins  to  break  glide . 

IH-N2.  Final  approach:  A/3  ranhe  from  beginning  of  last 
turn  until  student  begins  to  break  glide . 

V1-I13.  Final  approach:  A. ’3  rango  from  beginning  of  last 
Urn  until  student  begins  to  break  glide . 

II-M3.  Final  approach:  Chnnged  approach  course  or 
fed  to  hit  correct  landing  area . 

II- N'2.  Final  approach:  Changed  approach  course  or 

S'ed  to  hit  correct  landing  area . 

III- N3.  Final  approach:  Chnnged  approach  course  or 

S'ed  to  hit  correct  landing  area . 

VI-no.  Final  approach:  Maintain  glide  track  parallel 
with  "T" . . 


Validity 


1 

Iftu 

grad.— 

rllm. 


•  *0. 43 
.15 


.20 

•**.00 

••*.07 

••.33 

*.28 


.18 

•••.45 


.25 

•••.39 


r,kaU« 
versus  L. 
first 
day 


••*0. 42 
••*.29 
••♦.33 


.01 

.20 

.10 

.08 


.05 

.20 

•••.33 


r»an  V. 
versus  L 
second 
day 


••a  32 

.07 

.05 


«• 

•• 


Reliability 


nr  first 
versus 
second 
day 


•••a  43 
.02 
.03 
-.  10 
•••.44 
••*.22 
•••.20 
••*.31 
.03 
-.03 
.10 
•••.77 
•••*.28 
*.0S 
•-.03 
•••  M 


•  Tctrncborlc  correlation. 


Section  B:  Data  for  rn,  graduation-elimination 


Coda 

AT, 

Pi 

M. 

J 

SD, 

r»i» 

vim  . 

70 

74 

1.80 

1.57 

a  3t 

0.43 

ioi . 

33 

CO 

4  3.91 

4.20 

1.38 

.13 

I1INI . 

41 

08 

4  135.71 

155.38 

49.89 

.20 

vin2 . 

VW4 . 

71 

73 

73 

73 

0.20 

1.90 

4.10 

'.74 

1.39 

.18 

.90 

.67 

vine . 

73 

73 

2.45 

110 

.40 

.33 

ioa . 

33 

05 

4  3.  CO 

4.37 

I.Ofi 

.28 

1MN2 . 

VI  1)3  . 

39 

73 

07 

73 

4  17.13 
A  12 

18,85 

4.41 

A  76 

.7* 

.11 

.45 

IIIN'3 . 

38 

71 

.90 

.04 

.71 

.23 

VI B6 . 

73 

73 

1.00 

1.40 

.32 

.39 

‘  Lower  score  Is  bettor  soora. 


Taiile  AO. 3. — Accuracy  landing:  traffic  pattern  and  approach — Continued 
Section  C:  Data  for  rp*u  and  for  Reliability  m 


Fir  t  day 

Second  day 

Rrlla* 

bility 

ru 

test- 

r,sii 

AT 

M 

SD 

r»ki« 

AT 

Af 

SD 

retest 

t-comb. 

0.42 

<1 

a  44.02 

24.77 

0.32 

41 

•49.88 

22.70 

0.23 

0.02 

18 

78.03 

46.02 

38 

71.32 

39.08 

-.20 

.29 

45 

•  61. 30 

34.17 

.07 

46 

•  53. 70 

30.60 

.06 

.03 

43 

87. 67 

50.57 

43 

58.37 

41.03 

.03 

.33 

45 

•  55.70 
83.30 

34.40 

45.20 

.05 

46 

43 

•56.50 

60.90 

3a  90 
49.20 

-.01 
-.  19 

-.10 

.01 

41 

•7.44 

4.15 

.10 

41 

•  M6 

4.02 

.33 

.31 

38 

8.20 

4.02 

38 

7. 24 

3.92 

.28 

.20 

42 

•a  79 

4  34 

.02 

42 

•7.50 

2.94 

-.07 

.01 

41 

8.54 

4.17 

41 

7.68 

4.95 

.13 

.10 

43 

•7.33 

3.79 

.20 

43 

•  a  5i 

3.33 

.04 

-.03 

42 

8.10 

4.08 

42 

8.10 

4.36 

-.14 

.08 

45 

•7.89 

4.15 

.03 

45 

•  ao? 

3.86 

.24 

.10 

42 

8.  57 

3. 08 

42 

ao3 

4.44 

-.05 

.05 

41 

.06 

.47 

.20 

41 

.83 

.38 

.40 

39 

.62 

.49 

39 

.59 

.49 

.14 

.20 

43 

.79 

.41 

.32 

41 

.88 

.32 

-.02 

.05 

41 

.61 

.49 

41 

.61 

.49 

.13 

.13 

42 

41 

.74 

.41 

.44 

.49 

.23 

42 

41 

.07 

44 

.45 

.50 

-.35 

.24 

-.00 

Cod* 


101... 

IIMI 

MINI 

101... 

IIM2 

I  INI.. 

I I  INS. 
IIMI  . 
UNI.. 
IIIN3 


Upper  or 
lower 


ias 


I-ower 
Upper 
I/ower. 
Upper 
l/owcr 
Upper, 
l.owcr 
/Upper 
ll/ower 
/Upper 
Ixjwer. 
Upper 
lower. 
Upper, 
lower. 
Upper, 
lower. 
Upper. 
\  Lower. 


•  lower  score  Is  belter  score. 

Table  A6.4. — Accuracy  landing:  Place  and  manner  of  ground  contact 
Section  A:  Summary  data 


Validity 

Code  (8tudy,  maneuver  and  measure) 

1 

r.n 

grad. — 
cllm. 

**  K 

"  SiSs 

fc.  c* 

> 

8 

r»hi,  U. 
versus  L. 
second 
day 

VI-117.  O round  contact:  I«nndcd  In  crab . 

•0.  29 

VI-118.  Oruuiul  contact:  Landed  drifting . . . 

•••.  44 

I-G6.  I’lacc  of  contact'  Goal,  first  >4  of  field . 

-.19 

•••OlW 

•••0.32 

•.  24 

1I-M5.  I’laco  of  contact:  Goal,  middle  of  lone  100  feet  wide, 
600  feet  Ion* . . 

*.  19 

11 -N4.  Place  of  contact:  Goal,  middle  of  tone  200  feet  wide, 
coo  feet  Ion* . 

.10 

.  10 

111-N4.  Place  of  contact:  Goal,  middle  of  tone  200  feet  wide, 
run  feet  Ion*  . 

•••.  43 

*.20 

.13 

VI1-KI.  Place  of  coni  act:  Goal,  mlddleof  too*  200  feet  wide, 
coo  fi-ct  Ion* . 

.02 

V 1  l-F  1.  I’l  icc  of  contact:  Ooal,  middle  of  tono  200 feet  wkle# 

fi00 f«Tt  . . 

.03 

Vl-lltl.  Place  of  contact:  Ooal,  first  )4  of  field . 

-.23 

II-N.V  Place  of  contact  on  second  successive  landing:  Cor¬ 
rected  for  previous  over-  or  under-shootlnr . 

-.01 

-.05 

I1-.M6.  I.nndlnc  nttluidc:  Smooth  3-polnt,  tall  first,  wheels 
first ,  3-|x>lni  but  dropixxt  In  3  feet  or  more . 

”.26 

.09 

11-Nft.  I.andln  :  nttltiide:  Smooth  3-polnt,  tall  first,  wheels 

•e  17 

••.23 

.10 

.03 

I1I-N3.  f.nndinKnttiluiie:  Smooth  3-|mlnt,  tall  first, wheels 
flrrt,  3-polnt  bill  dropprsl  In  3  feel  or  more . . . 

••*.  36 

VII-K2.  I.andln*  nttltiide:  3-|>olnt  or  slightly  tall  first, 
wheels  first  with  lull  below  horizontal,  tall  horizontal  or 
hlirher . 

.02 

VI1-K2.  UandliiB  ntllludo:  3-i>olnt  or  slightly  tall  first, 
w  heels  first  w  ith  tall  below  horizontal,  tall  horizontal  or 

.04 

VI-H9.  landing  attitude:  Smooth  3-polnt,  tall  first,  wheels 
fir-1,  3  |Hilnl  but  dropped  In  1  feet  of  more . . 

••*.32 

1-GS.  PI  itio  bounced  . . 

-.  13 

•”.34 

*.21 

1I-M7.  PI  me  bonnied . 

.It 

-.06 

11-N7.  Plano  bounced  . 

-.03 

-.  10 

11I-N6.  Plano  bounced  . 

••*.69 

•*.  2t 

.01 

V1I-K3.  I* l:\no  bounced  of  dropped  In . . 

.00 

VINF.1.  l*|. mo  bounced  or  droppod  lo . . 

.01 

•••.60 

Reliability 


4 

ru  first 
▼ersus 
second 

day 


•••a  41 
51 

-.  10 


-.00 

•.20 

.07 


•.01 

•.01 

••*.37 

.00 

.0) 

-.01 

.11 

•-.09 


•••.20 

•**.41 

.00 

-.11 

-.09 

-.09 

•-.01 

•-.01 

•••.40 
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Table  AO. 4 — Accuracy  landing :  Place  and  manner  of  contact — Continued 


Section  B:  Data  for  rti,,  graduation-elimination 


Cods 

AT, 

Pt 

M. 

SD, 

r*w 

VIB7  . . 

77 

72 

1.83 

1.59 

0.23 

020 

VIB8. . ..  ... 

71 

72 

1  r.o 

1  43 

32 

.44 

108 . 

15 

(A 

•  A.  II 

5. 59 

1  34 

-,  It 

1IIN4 . 

37 

M 

1  08 

31 

I  14 

41 

VIB1I  .  . . 

73 

73 

2  71 

2  83 

.31 

-  23 

1IIN5  . . . . 

35 

fA 

3  48 

2.08 

1  53 

SA 

vino . .  ...... 

73 

73 

2  57 

2.  21 

«7 

12 

IG5  . . 

35 

M 

k  4  31 

4  08 

1  27 

-.  11 

Hires  . .  . . 

31 

71 

2.  82 

1  78 

.01 

.CO 

vimo . . . 

73 

73 

2.32 

1.78 

.51 

.CO 

*  Lower  score  Is  better  score. 


Section  C:  Data  for  rpbi.  and  for  reliability  rj| 


Cod* 


IOA . 

IIMB . 

IIN4 . 

IIIN4 . 

VIIEl... . . 

VIIFI . 

IIN5 . 

IIMB . 

UNO . 

II I  NS . 

VII EJ . 

VIIF2 . 

105...  . . 

HINT . 

IIN7 . 

IIIN6 . 

VHEJ . 

VIIFJ . 


First  day 


Upper  or  lower 


Ix>wer. .. 
/Upper  .. 
(Lower.  -. 
/Upper. .. 
ILower. . . 
JUppor. .. 
Lower. . . 

85  hrs  ... 

\ GO  hrs 
85  hrs.... 
,rohrs.... 

Upper . 

I-ower . . 

Upper . 

Lower . 

Upper . 

Lover . 

Upper . 

.bower . 

'85  hrs . 

,00  hrs . 

/ 85  hrs . 

,00  hrs . 

Upper . 

Lower . 

Upper . 

lower . 

Upper . 

\Ix)wcr . 

Upper . 

Lower . 

85  hrs  . 

00  hrs  . 

85  hrs . 

\0O  hrs . 


Second  day 


V 

M 

SD 

A7 

u 

}  0.12 

41 

rt 

3  73 
3  18 

0  32 

f  41 
77 

PI 

.It 

24 

.S3 

.Ml 

i  .34 

24 

23 

.57 

SI 

23 

,5l. 

.10 

» 

.82 

.70 

.15 

28 

1  7'1 

.67 

TV 

JO 

1  HI 

43 

.53 

.75 

i  .11 

43 

.47 

.02 

47 

931 

211 

.31. 
Lil 
1  04 

,5S 

.  TA 

.77 

4? 

.77 

.a 

954 

2M 

t  S3 
1.  7* 

TV 

.77 

-  01 

22 

22 

.55 

.59 

* 

50 

i  -.03 

22 

72 

.43 

.50 

.35 

’I 

1  Al 

1  01 

•  .09 

Jl 

1  VI 

77 

1  07 

■XZI 

77 

1  70 

.17 

IS 

1  71 

1.  lu 

38 

111 

Hi 

1  31 

1  72 

JO 

1  49 

4<> 

1  52 

1  IS 

V 

1  U 

.W 

44 

954 

210 

.01 
144 
1  40 

1.  17 
.75 
.72 

44 

L  25 

.04 

933 

211 

153 

147 

CH 

.44 

.14 

38 

1  30 

,75 

.31 

18 

1  45 

13 

2.  so 

1.  14 

13 

1  «' 

.14 

77 

1.91 

.70 

71 

1  38 

25 

1  12 

04 

7. 

1  40 

-.03 

13 

1  13 

.59 

-.10 

11 

1.53 

30 

1  40 

.V. 

10 

1  07 

.11 

43 

1  10 

■  87 

f  -.01 

43 

1  o> 

41 

.74 

.*7 

45 

l  07 

.00 

932 

117 

.10 
•  7V 

1  1 

2IC 

1  '0I 
r  l 

934 

■ir 

.tt 

till 

l£ 

SD 


0  38 
.50 
.TO 
.70 
.09 
.75 
.75 
.5# 


M 


AT 


0.07 
-.27 
-.00 
-.02 

:!! 

lao) 

(Mw- 170) 

(MW- 170) 

.44 
-.44 
-.21 
.31 
-.0tl| 
.04 


.  50t 
.50 
1.09 
1.15 
1.07 
1.17 
1.30  .  25] 


1.281 


—.02 


s 

31 

27 

38 

30 

40 

41 


(Mw- 170) 


(Mw— 170) 
.07 
-.OH 
-.11 
-.13] 
-.  ie| 
.ii 
•71  .01 
.*7|-.ril 


$ 

.471 


(MAT- 170) 
(MAT-170) 


Re 
bll 
t< 

rtLi. 
i-comb. 


-OilO 
-.00 
.30 
.07 
•.01 
*.01 
.00 
.09 
.01 
.13 
•-.00 
•.30 
.00 
-.  13 
-.09 
-.00 
•-.01 
•.01 
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Table  n8.5. — flecotery  landing  after  bounce  or  toom 


Section  A:  Summary  data 


Validity 

Reliability 

Code  (Study,  maneuver  and  mtuura) 

t 

raw 

grad.— 

ellm. 

a 

m 

• 

f»kta  U. 
versus  L. 
second 

day 

4 

Tn  lint 
▼er*us 
second 

day 

Id  J7.  Recovery  nft«*r  bounce,  student's  landing  attitude. 
Smoot  h  3-polnt,  toll  first,  wheels  first,  3-polnt  but  dropped 
In  3  or  rnort  . . 

aot 

••0.23 

an 

an 

Iff  II  lleeovery  aflcr  bounce,  student’*  landing  bounced- 
Not  nt  ill,  tinner  3  feet,  more  than  3  (eel,  „  . 

*.30 

•17 

.0* 

.to 

Ill  l.l.  Recovery  nfier  room,  student**  landing  attitude: 
Smooth  3-[>oliit,  till  first,  wheels  first,  3-potnt  but 

.13 

.07 

.04 

Ilf- M.  Iteeovery  After  zoom,  stmlont't  ian<f>nf  bounced: 
Not  at  all,  miner  3  feet,  more  than  3  feet.  ,  . . 

-.01 

.10 

l 

.08 

.00 

Section  B:  Data  for  ru„  graduation-elimination 


Cod# 

AT, 

V* 

M. 

Af. 

8D, 

raw 

IIIJ3 . 

41 

71 

2.44 

133 

107 

a  04 

dill .  . 

tl 

U 

107 

1.3S 

1.37 

.30 

dll.l. .  . 

41 

09 

1.93 

111 

1.13 

-.00 

I1II4 . 

41 

M 

1.72 

I.U 

1.14 

-.04 

Section  C:  Data  for  r,ti<  and  for  reliability  fn 


Coda 

Upper  or 
lower 

First  day 

Second  day 

m 

Relia¬ 

bility 

test- 

retest 

i-comb. 

- 

r»ai> 

N 

Af. 

SD 

r»au 

N 

Af. 

SD 

diia . 

IIIJ1 . 

him . 

HIM . 

/Upper . 

\I<owcr . 

/Upper . 

ll-ower . 

/Upper . 

\  Lower . 

/  Upper . 

\  Lower . 

0.23 

.17 

.13 

,0 

44 

44 

46 

44 
46 

45 

46 
45 

1.70 

1.11 

1.24 

.95 

1.39 

1.04 

1.07 

.19 

1.20 

1.30 
.41 
.45 

1.31 

1.32 
.79 
.90 

m 

E 

44 

44 

44 

44 

44 

45 

44 

45 

1.60 

1.45 

1.15 

i.n 

1.15 

.98 

1.04 

.83 

LIS' 

•1.34 

.74 

.89 

1.25 

1.18 

.43 

.88 

-a  17 

.24 

-.09 

.30 

-.08 

.14 

-.04 

.14 

aos 

.it 

.04 

.00 

Table  A8.G.—  Simulated  forceA  landing 


Section  A:  Summary  data 


Cods  (8tudy,  maneuver,  and  measun) 

Validity 

Reliability 

I 

raw 

grad.— 

ellm. 

2 

r»aw  U. 
versus  L. 
first 
day 

3 

r.aw  U. 
venus  L. 
second 
day 

4 

ru  first 
versus 
second 
day 

II -1.3.  A/3  range  In  gilds . 

•••a  39 
••.25 
MS 
.04 
••.07 
.04 
.04 
•.20 
.11 
*.04 

aoo 

.05 

.Cl 

.13 

a  07 
.08 
♦-.0* 
*.17 
•.03 
.07 
••  a 
*.  It 
.01 
•.07 

III-KJ.  A/3  more  In  gilds . 

d-1.2.  Slimihtes  haso  leg  nnd  00*  approach . 

III-K2.  .Mmuhtci  lm*e  leg  and  00*  approach . 

VI  1-1)1.  PlmulMiM  live  leg  and  W*  approach . 

•••a  f» 

•••.« 

d-I«4.  Comes  In  upwind,  cro-swlnd,  downwind  . 

HI-FI.  Comes  In  upwind,  crosswind,  downwind . 

d-I.I.  Would  havo  landed  In  first  H  of  field . 

HI-FI.  Would  have  landed  In  first  »io (  field . 

V1I-D2.  Would  hava  landed  In  Brit  ft  of  Held . 

•••.a 

.20 

.07 

•.20 

.13 

-.04 
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Table  AC.fl. — Simulated  forced  landing — Continued 
Section  B:  Data  for  graduation-elimination 


*  Lower  score  to  better  score. 

Section  C:  Data  for  r,bi»  and  for  reliability  ru 


Table  A6.7. — Four  180 •  climbing  turns  1.  Left  X.  Right  8.  Left  4.  Right 


Section  A:  Summary  data 


Validity 


Code  (Study,  maneuver  and  measure) 


II-D1.  R.  p.  m.  In  straight  climb  (Instruments  covered), 

deviation  from  correct . 

11-1)2.  M.  p.  b.  In  straight  climb  (Instruments  covered), 

deviation  from  correct . 

I-Dl.  Four  180*  climbing  turns:  8um  of  tlmo  (In  seconds) 
difference  between  turns  I  and  2  and  I  and  4,  disregarding 
sign . 


II- 01.  Sum  of  tlmo  (In  seconds)  difference  between  turns 

1  and  2  and  3  and  4,  disregarding  sign . 

III- D1.  Sum  of  time  (In  seconds)  difference  between  turns 

1  and  2  and  3  and  4,  disregarding  sign . 

11-1)3.  Sum  of  tlmo  (In  seconds)  difference  between  turns 
1  and  2  and  3  and  4,  disregarding  sign  (Instruments 
covered) . 

I- 112.  Four  ISO*  climbing  turns;  A/3  range,  sum  of  all  4 

turns . 

II- 02.  A/S  range,  sum  of  all  4  turns . 

III- 1)2.  A/3  range,  sum  of  all  4  turns . 

II- D4.  A/3  range,  sum  of  all  4  turns.  (Instruments 

covered) . ... 

III- 1)3.  First  ISO*  climbing  turn,  left:  Coordination,  In 

terms  of  deflection  of  bnll  In  ball-bank . 

111-1)4.  Second  iso*  climbing  turn,  right:  Coordination,  In 
terms  of  deflection  of  bnll  In  ball-bank . 

1II-IIS.  Third  ISO*  climbing  turn,  left:  Coordination,  In 
terms  of  deflection  of  ball  in  ball-bank . 

III-US.  Fourth  IM)*  climbing  turn,  right:  Coordination,  In 
terms  of  deflection  of  boll  In  ball-bank . 


Reliability 


ru  Ural 
versus 
second 
day 
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Table  AG.7. — Pour  180*  climbing  turns  I.  Left  9.  Right  3.  Left  4.  Right — Con. 
Section  B:  Data  for  ru*  graduation-elimination. 


N, 

9* 

U 

00 

41 

es 

35 

M 

40 

67 

40 

07 

M, 

BD, 

41.43 

31.03 

73.00 

37.30 

6.06 

LOS 

mu 

lass 

an 

1.00 

*  Lower  (core  ie  better  mot*. 

Section  C:  Data  for  rPu,  and  for  reliability  ru 


Second  dey 


Relia¬ 
bility 
fit  teit- 
retest 
«-comb. 


Table  A6.8 .—Four  180 *  gliding  turnt  1.  Left  t.  Right  S.  Left  K.  Right 
Section  A:  Summary  data 


Code  (Study,  maneuver,  and  meaiure) 


II-Kl.  A/9  In  straight  normal  tilde,  deviation  from  cor* 
rcct  A/3  (Instrument*  covered). . 

I- FI.  Four  ISO*  gliding  turn*:  Sum  of  time  (in  seconds)  dif¬ 
ference  between  (urns,  (1-2)  plus  (1-4),  disregarding  sign... 

II- Kl.  Sum  of  time  (in  seconds)  difference  between  turns, 

(1-2)  plus  (2-4),  disregarding  sign . 

II-E2.  Bum  of  time  (in  seconds)  difference  between  turns, 
(1-2)  plus  (3-4),  disregarding  sign,  instruments  covered  . 

Ili-KI.  Sum  of  tlmo  (in  seconds)  difference  between  turns, 
(1-2)  plus  (3-4).  disregarding  sign . 

I- F2.  1  our  ISO*  gliding  turns:  A/S  range,  sum  of  all  4  turns... 

II- K2.  A/S  range,  sum  o(  all  4  urns . 

II- E3.  A/S  rnrigc.sumof  all  4  turns,  Instruments  covered.. . 

III- E2.  A/S  range,  sum  of  all  4  turns . . 

I1I-F.3.  First  180*  gliding  turn,  left:  Coordination,  in  terms 

of  deflect  ion  of  ball  In  ball-bank . . 

11I-K4.  Second  180*  gliding  turn,  right:  Coordination,  In 
terms  of  deflection  of  ball  in  ball-bank . . 

1II-K5.  Third  ISO*  gliding  turn,  left:  Coordination,  In  terms 
of  deflection  of  boll  In  ball-bank . 

llf-KO.  Fourth  ISO*  .'tiding  turn,  right:  Coordination,  In 
terms  of  deflection  or  pal]  in  bed-bank  (rn,  fur  4  turns  com¬ 
bined) . 


Validity 


raw 

grad.— 

elim. 


*0.23 


*.20 

.12 


-.21 


-.04 


r»ki,U. 
versus  L, 
first 

day 


0.04 

.01 

.04 

.14 

-.10 

••*.30 

•.IT 

***.20 

*•*.45 

-.00 

-.05 

.01 

.03 


r»ku  V. 
versus  L 
second 
day 


-0.02 

M0 

.00 

.04 

-.09 

••*.30 

**.21 

*20 

••*.14 

.01 

-.02 

-.02 

.07 


Reliability 


ruflnt 

versus 

second 

day 


All 

•••.01 

•••.20 

••.23 
•.If 
.00 
••  « 

•*•.20 

.11 

.00 

.2) 

M0 


Section  B:  Data  for  rk(i,  graduation-elimination 


Code 

N, 

Pi 

St, 

St. 

Sit, 

in . 

33 

CO 

•  21.30 

29  23 

13.00 

IIIEl . . . 

41 

71 

•1.03 

10.00 

4.20 

IKS . 

33 

GO 

•  •  4.  SI 

4. 83 

1.40 

Ill  K2 . 

40 

73 

•  39.ro 

81.  M 

21.07 

IIIEl.  4.0.0 . 

40 

72 

21.03 

2109 

X  73 

•  Ixiwer  score  Is  better  score. 

•  Coded  soon. 


703322— «T - 27 
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Table  A6.8. — Pour  180*  gliding  turnt  1.  Left  t.  Right  S.  Ltjt  4.  Right — Con, 
Section  C:  Data  for  r»bi«  and  tor  reliability  fu 


Pint  day 


Second  day 


coa.  I  UfiKr* 


r* u  N  \  M  8D  I  r..u  S  I  M  8D 


HK. . te 

W» .  » 


Uwir. . . 


. \Ieowcr . / 

. •loi 

»k« . te;:::::::::}  wl 


. i  I  "owl  r 

n«» . 2SS: 

itivs  Upi»cr. 

lnt* .  l-ower. 

tun  Upper. 

,llr' .  lower. 


BK-™}  -“I 
S»:™}  -"I 


40  a  It.  10 

38  II. 29 
46  *3.52 

43  3.72 

46  *  1 70 

42  148 
4li  8  4.37 

44  181 

44  83.W 

41  4.  I& 
41  831.34 
IS  2a  58 
40  8  |X39 

43  1163 

46  8|4.|3 
43  19.07 

46  8  2a  65 

43  31. 16 

46  165 

44  173 

46  167 

44  173 

45  180 

43  177 

46  1 78 

44  175 


?:»}• 

114 

137 

101 

135/ 

1M  L 

131 
181  1_ 
129/ 
7.57 
•.II 
6.32 
191 
7. 40  1 
171 
157 
11.85/ 

.  52 
.45 

:S5  - 

:8  - 

.41 

.55 


8  •.  43 
1103 
8165 
195 
8150 
162 
8130 
4.77 
8162 
141 
8  17. 13 
24.87 
8  1150 
16.28 
8  14.51 
II 49 
8  10.35 
27.91 
180 
177 

172 

173 
160 
170 

174 
166 


Relia¬ 
bility 
rn  tot- 
retest 
1 -comb. 


8  Lower  (core  to  better  koto. 


Table  A6.9. — 860*  tteep  turn$  at  eruiting  throttlo 
Section  A:  Summary  data 


Validity 


Reliability 


Code  (study,  maneuver  and  measure) 


...  r»au  U.  r,au  U.  61  first 
versus  L.  versus  L.  verms 
*iVZ.‘  first  second  second 

*"“•  day  day  day 


I- Cl.  Time  In  seconds  to  complete  turns:  Led  and  right 

strep  turns . 

II- Cl.  Time  In  seconds  to  complete  turn:  Left  steep  turn, 

Instruments  covered . 

11-114.  Time  in  seconds  to  complete  turn:  Ri(bl  strep 

turn,  Instruments  eovered . 

Il-ltl.  Time  In  seconds  to  complete  turn:  Left  steep  turn 
il-C4.  Time  In  seconds  to  complete  turn:  Rljbt  steep 
turn.  Instruments  covered . 

I- C2.  l-ooks  nround  50  (H-rc-citt  of  the  time:  Left  and  rljht 

steep  turns . 

II- 112.  Looks  around  20  percent  of  the  lime:  Left  steep 

turn . 

IMIS.  Looks  around  20  percent  of  the  time:  Right  steep 

turn . 

II-CJ.  Inoks  n'oond  20  percent  of  tlie  lime:  Left  steep 

turn,  lastruments  covered . 

Il-CS.  looks  nround  50  ivrcent  of  Ihc  lime:  Rljht  steep 
turn.  Instruments  covered  . 

I- 0.  Alilm-te  rnnre:  1-rlt  nnd  rl.-ht  steep  turns . 

II- 113.  A  It  I*  ude  rnnee:  left  strep  turn . 

11-116.  Altitude  range:  Right  steep  turn . 

1I-C3.  Altitude  range:  Lett  sleep  turn,  butrumenta  cov¬ 
ered . 

1I-C6.  Altitude  range:  Right  steep  turn,  Instruments  cov¬ 
ered . 


•a  it 

•0.15 

•••an 

*.  16 

.10 

•••.51 

.02 

.07 

•••.36 

.04 

.12 

...,43 

.13 

.10 

•••.36 

•••.28 

•••.43 

••*.39 

•••.30 

.00 

••.27 

••  19 

-.05 

••••.49 

.04 

.13 

•.07 

-  09 

.01 

•  04 

••*.62 

••33 

*.  19 

•*•.36 

11 

••.20 

•••.35 

••22 

•••.41 

•••.37 

— .  U5 

•••.33 

••*.32 

•It 

.U 

Table  A6.0. — 360 •  ittep  turn*  at  eruiting  throtllt — Continued 
Section  B:  Data  for  rn„  graduation-elimination 


Code 

ff, 

Pi 

M, 

Mi 

8D, 

rsb 

IC1 . 

u 

M 

*.  •  #.  21 

0.  IT 

tn 

-.01 

ICJ . 

si 

M 

m..*> 

4. 43 

1.  to 

,0» 

ica . 

31 

CO 

•.S3. 01 

142 

1.77 

.11 

►  Lower  score  It  better  score. 
•  Coded  score. 


Section  C:  Data  for  mm!  for  reliability  r« 


*  Lower  score  Is  better  score. 
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Table  AO.  10. — 300 *  iteep  turn*  at  full  throttle 
Section  A:  Summary  data 


t 


Validity 

Reliability 

Coda  (study,  maneuver,  and  maaaura) 

1 

rats 

grad.— 

slim. 

S 

r.stt  U, 
versus  L. 
flrat 
day 

S 

r»vi.  U. 
versus  L. 
second 

day 

4 

fix  flrat 
versus 
second 
day 

I-C4.  Tima  In  seconds  to  oompleta  turns:  Left  and  right 
itef'p  turns . 

0.08 

mi 

*0i30 

***0.43 

11-117'.  Time  In  seconds  to  complete  turn:  Left  iteep  turn.. 

.13 

•••.43 

ii-iilO.  Tima  In  teconds  to  complete  turn:  Right  iteep 
turn....  - . . .  . 

—.04 

.13 

•••.80 

II-C7.  Time  In  teeonda  to  complete  turn:  Left  steep  turn, 
instruments  covered . .  . 

B.  : 

*.1» 

.15 

••Ml 

II-C10.  Time  In  seconds  to  complete  turn:  Right  iteep 

■ 

M0 

.10 

•••.31 

III-Di.  Time  In  seconds  to  complete  turn:  Left  steep 
turn .  . . . . . . 

-.00 

-.04 

-.0) 

••*.43 

III-DJ.  Time  In  seconds  to  oompleta  turn:  Right  steep 
turn . 

-.00 

.00 

-.03 

•••.« 

I-C4.  Looks  around  SO  percent  of  the  time:  Left  and  right 
it*?p  turns . 

.00 

M3 

•••.41 

X1-H8L  Looks  around  SO  percent  of  the  time:  Left  steep 
turn . 

•14 

a 

•••.81 

II-llll.  Looks  around  SO  percent  of  the  time:  Right  steep 
turn . . . . 

•.17 

mi 

•••.n 

II-C8.  Looks  around  50  percent  of  the  time:  Left  steep 
turn.  Instruments  covered . . 

.14 

■n 

*.03 

II-Cll.  I-ooks  around  SO  percent  of  the  time:  Right  iteep 

;  B 

—.09 

.it 

•  —.18 

III-Di.  Looks  around  SO  percent  of  tlr:e:  Left  stoep  turn. 
Ill- DO.  Looks  around  SO  peromt  of  the  tune:  Right  iteep 
turn . 

.11 

—.01 

.07 

.10 

•».3I 

••Ml 

•  -.M 

•  -.» 

I- CO.  Altitude  range:  Left  end  Right  Steep  turns . 

II- llO  Altitude  range:  Left  steep  tun* . . 

*.15 

•••.It 

••Ml 

•*M4 

.07 

•.30 

••M0 

fv.ifia  Altitude  range:  Right  iteep  turn . . 

■■■■■■■■■■■I 

••.37 

.03 

.11 

*.17 

"•.E 

H-C0.  Altitude  range:  Left  steep  turn,  Instruments  oov- 
trod.. . . . . . . . 

••.37 

1I-C12.  Altitude  range,  Right  steep  turn,  Instruments  oov- 
trsd.... . . . . 

i 

•••.44 

.14 

•ill 

III-DS.  Altitude  range:  Left  steep  turn . 

III-D7.  Altitude  range:  Right  steep  turn . . 

.30 

.13 

•••.30 

••.38 

•w.U 

•••e«7 

.04 

•••.37 

VTl-Cl.  Maximum  deviation  from  starting  altitude:  Left 
and  right  steep  turns . . . . 

•••.U 

•••Ml 

••MT 

VII-C2."  Maintained  bank  of 00*  or  greater:  Left  and  right 
steen  turns......... . . 

•.os 

H  ■ 

Vli-Ol.  Final  roll-out  within  .43*  of  starting  heading: 
|/»ft  mil  Hpht  iteep  turns . . . . 

.01 

A  03 

•*.33 

1U-D4.  Coordination,  In  terms  of  deflection  of  bell-bank: 
IWt  steep  turn..... . . . 

13 

.04 

*.u 

Ill  -Da.  Coordination,  in  terms  of  deflection  of  ball-bank: 
Right  iteep  turn . . . . 

.07 

•.30 

•.05 

M0 

Section  B:  Date  for  rki,  graduation-elimination 


Code 

AT, 

P • 

V, 

M, 

SD, 

VSSi 

IC4 . . 

98 

00 

eg.  50 

4.74 

1.00 

0.04 

43 

00 

•  43.00 

41.43 

Olio 

-.04 

34 

00 

•  44.33 

4144 

11.93 

-.04 

.00 

38 

M 

4.47 

4.47 

1.73 

00 

.07 

.88 

.03 

.11 

71 

,80 

.01 

.44 

—.01 

04 

•  ioi 

M3 

1.78 

.38 

in  r>s . 

1 

00 

•303.41 

370.00 

334.33 

.30 

IIID7 . 

40 

70 

•  308,21 

308.33 

101.83 

.18 

UID4 . 

40 

70 

8.2S 

8.43 

.07 

—.13 

lima . . 

41 

60 

4.04 

4.88 

1.33 

.00 

Table  A0.10. — 360*  elttp  (urns  at  full  throttle — Continued 
Section  C:  Data  for  and  for  reliability  fit 


k  Lower  score  Is  lbs  better  soor*. 


Table  A6.ll. — Maintaining  altitude  irhile  reducing  A/5 
Section  A:  Summary  data 


Code  (Study,  maneuver,  and  measure) 

Validity 

Reliability 

1 

yrml.— 

ellra. 

S 

f»»4  U. 
versus  L. 
first 
day 

S 

r,n.U. 
versus  L. 
second 
day 

« 

ns  first 
versus 
second 
day 

I-Dl  Altitude  ranee,  sum  of  two  trials. . . 

*0. 20 
•.SO 
.10 

•••aw 

aot 

•••0.72 

1-1)2.  Altitude  ranee,  sum  of  first  day  s  trials . . 

I-D*.  Altitude  ranee,  sura  of  second  day  a  trials . 
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Table  AO.ll. — Mainlining  altitude  u\ile  reducing  AjS — Continued 


Section  D:  Data  for  rau,  graduation-elimination 


Code 

Ni 

ft  ' 

V. 

8D, 

ID1  . 

■n 

mm 

ka.ee 

4.43 

L7S 

o.ao 

mi  i»t  dir . 

k  1.17 

3.43 

Lie 

.30 

1D2  2nd  dir . 

■ 

L tSKi  i 

k  LS3 

Lee 

.M 

.16 

mm 

*  Lower  score  U  better  NM1 


Section  C:  Data  for  r,n«  and  for  reliability,  m 


Code 

Upper  or 
lower 

First  dir 

Second  dir 

Til 

Relia¬ 
bility 
test- 
re  teet 
t-eomb. 

r»M« 

N 

M 

SD 

r»Mt 

W 

M 

8D 

IDS . 

}c.m 

l  41 

\  38 

k  103. 37 
288.84 

80.34 

134.54 

}  0.01 

m 

mm 

mm 

c 

m 

m 

k  Lower  More  ti  better  score. 


Table  A8. 12. — Rudder-exercite  and  pouer-an  $tall» 
Section  A:  Summary  data 


• 

Validity 

Reliability 

Code  (Studr.  maneurer,  and  measure) 

1" 

1 

%kkU. 

3 

u. 

4 

rwu 

jrad. — 
slim. 

rit  Hist 

versus  L. 

versus  L. 

versus 

Orat 

second 

second 

day 

day 

day 

It-Dt.  Rudder-eserdM  stall:  Time  to  lose  500  feet . 

aoo 

••0.31 

a  13 

II-DS.  Ladder-exercise  stall:  Maximum  anile  of  wlnp 

Hmmr. 

with  horizon . 

•*.23 

••.34 

II- 1)3.  ltuddcr-cxerebe  stall:  Maximum  directional  chance. 

I II-  Ol .  I’owrr-on  stall  recovrrr:  Stalled  ailerons . 

BBajiBB 

•••.40 

••.34 

•*.33 

•a  38 

*.  18 

•01 

0) 

1II-C2.  Power-on  Mall  recovery:  Time  from  forward  stick 
to  level  fllrht.  Short  time  Is  best . 

.10 

•*.33 

M0 

MO 

III-C3.  Power-on  stall  recovery:  Throttle  forward  with 

stick  In  recovery . 

.M 

•.  If 

*.  17 

0) 

III-C4.  Poweron  stall  recovery:  Maximum  A/3  In  re- 

covery.  Low  a/8  Is  best . 

••.43 

•.80 

•*.23 

•••.41 

Section  B:  Data  for  rki„  graduation-elimination 


Coda 

AT, 

Pi 

M. 

SD, 

rsa 

met . 

43 

69 

1.62 

1.23 

063 

0.38 

IIIC3 . .  . 

42 

60 

*13.43 

16.15 

166 

1 1 103 . 

42 

09 

1.73 

1.54 

.56 

.34 

I1IC4 . 

42 

09 

k  173. 10 

100.77 

34.33 

.43 

*  Lower  More  Is  better  score. 


i 

i 
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Table  AO.  12.  Rudder-ezercite  and  powtr-on  tlallt — Continued 
Section  C:  Data  for  r,k(„  and  for  reliability,  rit 


Table  A6.13. — Spin  reentry 


Section  A:  8ummary  data 


Validity 

Relbbaitf 

Code  (Study,  maneuver  and  meature) 

1 

raw 

grad.* 

elitn. 

2 

r,su  If. 
versus  L. 
first 
day 

3 

rAI<  O. 
versus  L. 
second 

day 

4 

rn  first 
versus 
second 
day 

I-EI.  Did  student  apply  opposite  rudder  at  2  luma  ±44*?. 

*0. 23 

•••a  33 

•a  it 

0.01 

II-JI.  Did  student  apply  opposite  rudder  at  IH  turns 
within  ±22*, -MS*,  or  more* . 

•••.31 

.13 

.13 

j  I-E2.  Time  In  seconds  from  opposite  rudder  till  note  cuts 

horizon .  Short  time  Is  best . 

•.22 

.13 

••♦.33 

•••.IT 

II-J2.  Time  In  seconds  from  opposite  rudder  I  Ul  nose  cuts 
horizon,  Short  time  Is  best . 

.11 

.00 

-.10 

I-E3.  Maximum  A/S  In  dive,  corrected  for  Indicator  error 
by  subtraction  of  cruising  Indicated  A/S.  Low  A/S  b 
best,  (See  text) . 

•.30 

.00 

.00 

••.34 

II-/3.  Maximum  A/S  In  dive,  corrected  for  indicator  error 
by  subtraction  of  cruising  Indicated  A/S,  Low  A/S  b 
best.  (See  text) . 

.11 

-.01 

•••.30 

Section  D:  Data  for  graduation-elimination 


Code 

s, 

Pi 

Me 

M, 

SO, 

raw 

IEI . 

33 

tA 

•  HU 

T.35 

1.74 

a  23 

I  Eg . 

35 

M 

Hi.  59 

4.32 

1.3V 

.33 

1E3 . . 

30 

04 

k&LtS 

04,44 

14. 10 

.30 

►  Lower  score  b  better  tom, 
*  Coded  toon. 
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Table  A0.13. — Spin  recovery — Continued 
Section  C:  Data  for  r,n,,  and  for  reliability,  m 


Table  A0.14. — Validity  and  reliability  coefficient  of  objective  item*  uted  in  primary 

check  ride  adminietered  in  ttudy  IV 

8cction  A:  Summary  data 


1 

S 

• 

• 

Validity 

Validity 

Reliability 

rate 

Pass- tad 

Uppc£iowtr 

.  f|* 
Ttat-ntaat 

Medium  Tuaxa: 

a.  Afrcement  on  coordination . 

-a  07 

.00 

-an 

•rtxa: 

6.  Agreement  on  direction . 

—.00 

t.  AKrccnicnt  on  number  of  turns .  . 

•  30 

titty  f 

•.17 

4.  Aerccmeut  on  application  of  (tick . 

—.34 

mj 

.10 

Forward  Slim: 

e.  Alripccd  range.- . 

•.27 

H 

.10 

/.  Bcore  on  highest  air  speed . 

•MO 

.01 

•*.20 

ir.  l'art  of  plane  over  rood . 

♦.a 

A.  Sllp|)ed  4  ball . 

*.34 

I 

•••.30 

I.  Instructor  took  over . 

—.17 

-j 

.00 

SurriNo  Turns: 

J.  Airspeed  range . 

—.00 

••.25 

•*.30 

Tt.  Ficoro  on  highest  air  speed . 

.07 

•.22 

•••.31 

1.  Plane  stalled . 

17 

•  14 

•••.44 

in.  Itcmalncd  In  slip . . . 

•.30 

*.30 

••.25 

•••.40 

n.  Recovery  made  at  ±5*  from  90* . 

•••.45 

••.27 

a.  Instructor  took  over . 

.30 

.11 

••.27 

••.35 

-.04 

•••.44 

Power  Landings: 

p.  Approach  pattern . 

f.  Placo  of  landing . 

.00 

.14 

•M0 

r.  Air  speed  range . . . . . 

•  00 

—.03 

a.  Bcore  on  hi»».  aL*  speed.- . 

—•01 

—.01 

t.  Land  In  er  J> . I . 

.17 

Pi 

—.15 

M.  Lnnd  drift ln« . 

••*.43 

.  PS 

.00 

V.  Typsof  landing . 

•.27 

*.17 

w.  Plane  bounced . 

—.04 

m*  ■ 

.13 

X.  Landlnf  roll . . . 

••*.40 

*.3t 

•-.17 

Cross-wind  Landings: 

1 .  Variation  'rora  £00  feet  in  traflle . 

.12 

•••.43 

-.07 

s.  Dal)  deviation  on  approach  turn . 

.23 

*••.35 

-.01 

•Correlation  significant  at  20-percent  level  or  abort. 
••Correlation  significant  at  6-percent  level  or  abort. 
•••Correlation  slsnlflctrit  at  1-pcrccnt  Itrel  or  abort. 


m 


Table  A6.14. —  Validity  and  reliability  enej/icients  of  objective  ittmt  uted  in  primary 
check  ride  adminitlered  in  itudy  I  V — Continued 

Section  B:  Data  for  biscriat  correlation  with  graduation-elimination 


Section  C:  Data  for  point-biscrinl  correlation  with  upper  and  lower  groups  chosen 

by  instructors 


Table  A8.14. — Validity  and  reliability  coefficient  of  objective  itemt  uted  in  primary 
check  ride  adminitlered  in  ttudy  I  V— Continued 

Section  D:  Data  for  tcst-rctcst  reliabilities 


Tint  rid* 

Second  rid* 

n» 

N 

AS 

8D 

N 

AS 

8D 

M 

3.88 

1. 44 

56 

4.11 

1.44 

-in 

» . 

*3 

686 

.52 

42 

190 

.43 

-.06 

65 

1118 

1. 19 

65 

1115 

1.37 

•.  17 

63 

4.34 

1.64 

63 

4.08 

L34 

.10 

64 

13.69 

128 

64 

14.38 

L77 

.10 

/ . 

63 

6  24 

139 

65 

178 

119 

••26 

66 

4.21 

1.50 

66 

133 

L68 

•.» 

66 

607 

1.41 

66 

146 

LOS 

•••.39 

66 

600 

.00 

66 

189 

.45 

.00 

63 

13.83 

1.94 

63 

1165 

L  49 

••.29 

* . 

63 

7.15 

119 

63 

7.94 

L6S 

•••.31 

1 . 

64 

685 

.65 

64 

189 

.46 

•••.44 

66 

632 

1.80 

66 

1C1 

L  41 

•••.40 

66 

4.86 

1.23 

66 

176 

L49 

•*.27 

66 

693 

.37 

66 

189 

.19 

-.04 

47 

630 

1.40 

47 

168 

1.X 

•••44 

40 

660 

.68 

49 

161 

.78 

*.  19 

65 

11 47 

1.88 

65 

1189 

104 

-.03 

65 

689 

142 

65 

4.78 

111 

-.01 

64 

633 

1.33 

64 

100 

1.63 

-.16 

63 

631 

1.35 

63 

111 

1  IS 

.09 

65 

6  42 

1.51 

63 

171 

1.71 

•17 

65 

615 

1.36 

65 

133 

1.49 

.13 

65 

4.29 

1.64 

63 

118 

L76 

•-.17 

63 

10.43 

187 

63 

1198 

145 

-.07 

63 

7. 45 

L88 

63 

106 

107 

-.01 

Table  A0.15. — In  study  IV,  correlation  behreen  instructor's  ratings  and  gradua¬ 
tion-elimination 


N, 

*v. 

P*J. 

P/-. 

P/Ji 

tm 

Oradu*tlon-«llmln*tlon  ».  Instructor** 
ratine* . 

61 

63 

X 

.03 

17 

•*176 

Table  A6.16. — Data  for  ttudy 
Graduation — Elimination 


AT, 

P, 

AS, 

AS. 

8D, 

»u. 

Tim*' . 

38 

79 

*6167 

74  X 

IX 

•*0.43 

Upper  v.  Lower 

If, 

P. 

AS. 

AS* 

8D, 

ran 

Tim*  ' . . 

46 

33 

»66.» 

71.10 

137 

IX 

Test-retest  reliability 

Flntdsy 

Second  d*y 

hi 

If 

AS 

8D 

If 

AS 

8D 

Tim*  ■ . 

46 

35.07 

113 

44 

34  41 

114 

113 

i  ’a  minute*— no  of  two  check  rid**. 


Table  AO.  17. — Semi-partial  reliability  correlation*  in  Study  VI 


Formula: 


rii-iHM) 


—  rnrtt~l-rt>r|trn 
Vi-r1!*  Vi  —  r*»4 


Variable  i  =  Odd  score.  Variable  i«=Odd  hours. 

Variable  j«=Evcn  score.  Variable  4  =  Even  hours. 


Coda  (Study,  maneuver, 
and  measure) 

ru 

ru 

ru 

ru 

Tm 

ru 

r«.n  iso 

*r*<i.t>  (s-a 

V-Al . 

MTT1 

0.42 

0.44 

mm 

0.53 

0.95 

a  « 

a  71 

V-A2 . 

BBT/I 

.62 

.62 

■ri 

.64 

.95 

.76 

.84 

V-A3 . 

Bl  1 

.01 

.07 

'iii 

.18 

.96 

.74 

.84 

V-A4 . 

.73 

.43 

.49 

Krf 

.57 

.95 

.41 

.74 

.72 

.43 

.54 

.53 

.95 

.60 

.76 

.77 

.44 

.48 

Hi 

.54 

.95 

.48 

1 

.85 

.57 

.59 

.66 

.68 

.95 

.75 

.84 

.71 

.44 

.64 

.53 

.60 

.96 

.55 

.71 

.84 

.44 

.69 

T 

.75 

.95 

.64 

.78 

.84 

.34 

.41 

1  B  X 

.37 

.95 

.83 

.91 

.47 

.36 

.48 

:  B  1 

.49 

.30 

.44 

.81 

.51 

.69 

1  f  \\ 

.44 

Hr] 

.34 

.81 

.47 

.64 

.41 

.65 

■ 

.46 

.43 

V-B7 . 

.67 

.36 

.44 

iB  ..... 

.35 

.95 

.63 

.68 

V-B8 . 

.48 

.64 

.60 

.  3S 

.44 

.95 

.61 

.74 

.44 

.46 

.47 

.60 

.54 

.95 

.63 

.08 

.79 

.70 

.73 

.63 

.64 

.95 

.54 

.73 

V-Bll . 

.60 

-.26 

-.11 

-.15 

.00 

.95 

.47 

.44 

*r*(i.n  (t  o  Is  the  scml-partlal  odd-even  reliability  correlation  corrected  by  the  Spearman-Brown  formula 
to  12  administrations. 


Table  A6.18. — Data  for  itudy  VI 


2.  Check  ride  by  regular  instructor. 

3.  Check  ride  by  different  instructor  ("aw itch”- ride). 

4.  Check  ride  by  regular  instructor. 


Coda  (Study,  maneuver  and  measure) 

ra 

ru 

Combina¬ 
tion*  06 
r»  and  ru 

Spearman* 
Brown  for  11 
times  lenfth 

V-Al . . 

a  20 

a  64 

&  45 

an 

V-A2 . 

.03 

-.08 

-.03 

-.27 

V-A3 . 

.49 

.19 

.34 

.84 

V-A4  . 

.13 

.23 

.19 

.74 

V-Al . 

.13 

.24 

.19 

.74 

V-Al . 

-.00 

-.13 

-.43 

V-A7 . 

.30 

.28 

.24 

.79 

V-Bl . 

-.04 

-.14 

-.10 

-.87 

V*B3 . 

.01 

.07 

.04 

.33 

V-B3 . - 

.05 

.29 

.17 

.71 

V-B4 . . . 

—.03 

-.1, 

-.07 

-.47 

V-B3 . 

.28 

.12 

.20 

.71 

V-B6 . 

HI1 

-.02 

.08 

.51 

V-B7 . 

.22 

.04 

.13 

.44 

V-BS . 

L  HV'!  1 

.07 

.09 

.64 

V-B9 . 

.01 

.13 

.07 

.47 

V-B10 . 

-.13 

.11 

-.01 

-.11 

V-Bll . 

-.14 

-.10 

-.13 

-.63 

•Combined  by  tbt  (-transformation  technique. 
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Tadi.r  A6.19. — Datajrom  itudy  VII  for  teit-reteit  reliabilitiea 


Coda 

Oarner,  N«*70 

Chicbasba.  N-100 

1 

*• 

centt 

M 

Test 

Retest 

I 

Test 

Retest 

.V 

m 

M 

SD 

M 

SD 

M 

SD 

vn-At . 

2.  51 

ar» 

230 

m 

a  07 

2  32 

a»2 

0.89 

ait 

a  14 

a  is 

vu-m . 

2  14 

.96 

2.31 

HI 

.00 

1.84 

.06 

.97 

.34 

.20 

.28 

VII  Cl  . 

1.81 

.62 

1.97 

w  1 

.20 

1.47 

.68 

.61 

.23 

.23 

.32 

vii-ca . 

r  ri 

.48 

276 

.82 

.01 

203 

.64 

260 

.63 

.21 

.13 

.17 

VII-O . 

.41 

286 

.62 

.00 

.00 

m 

.28 

.00 

.02 

.03 

VII-DI . . 

I1  1 

.24 

|Ijl 

.33 

.02 

.63 

Iti 

.61 

.03 

.03 

.03 

VII-DJ . 

.62 

H/i 

.67 

.06 

1 

.75 

240 

.02 

.03 

.04 

.07 

Vll-Kl. . 

1.89 

.78 

llll 

.81 

-.02 

1.69 

.76 

1.44 

.74 

.04 

.02 

.03 

VH-KJ . 

2.67 

.63 

|i|;i 

.71 

-.23 

216 

.01 

233 

.90 

.03 

-.07 

-.00 

vu-m . 

231 

.73 

Itll 

.83 

-.04 

214 

.02 

212 

k:i 

.01 

-.01 

-.01 

vii-fi. . 

1  83 

.76 

.81 

.05 

1.59 

.74 

.78 

-.02 

.01 

.01 

VII-F2  . 

209 

.62 

.63 

.24 

220 

.83 

.77 

.06 

.14 

.20 

VU-FJ . 

2  41 

.82 

237 

.83 

.11 

2  20 

.86 

237 

.81 

-.06 

.01 

.01 

The  coefTtclenU  for  the  two  elementary  ichooU  were  combined  by  the  s-transformatlon  technique  and  than 
corrected  (or  broad  calcgoriea  used  In  this  Freeze  Study. 


Table  A6.20. — Landing!  in  itudy  VII.  Teat-reteal  reliabilitiea  Garner  and 
Chickaiha  data  combined  N— 170 


7|| 

First  day 

Second  day 

If 

U 

SD 

If 

M 

SD 

Zone  plane  lands: 

■I 

m 

1>|  Undine,  1st  day  f.2d landing,  2d  day. 

0.00 

1.71 

an 

L66 

280 

2d  Undine,  1st  day  a.  1st  landing,  2d  day. 
Landing  attitude: 

•.  to 

■J 

l.GS 

.77 

14 

L48 

.79 

1st  landing,  1st  day  ?.  2d  landing,  2d  day. 

-.03 

236 

.84 

Bui 

240 

.72 

2d  landing,  it  day  f>  1st  landing,  2d  day. 
Plane  bounevd .  r  dronivd: 

-.04 

U 

244 

.79 

mi 

244 

.81 

1st  Undlng  1st  dr  y  t.  2d  landing,  2d  day. 

.07 

170 

2  21 

.84 

in 

234 

.84 

2d  landing.  1st  day  a.  1st  landing.  2d  day. 

•-.  13 

170 

229 

.84 

170 

223 

.18 
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APPENDIX  TO  CHAPTER  SEVEN _ 

Measures  of  Two-Engine  Flying 
Skill  (Contact) 


Table  A7.1. — Summary 

\fa  nfuur 

Formation  straight  and  level. 


Formation  cross  under  (and  re¬ 
turn). 

Formation  turns  (two  180's). 


Formation  let-down  and  climb. 


Steep  turns  to  right  and  left. 


Slow  flying— straight  and  level. 


Slow  flying  turns  (right  and  left). 


Single-engine  out  of  slow  flying. 


Power  off  stall  (gear  and  flaps  up). 


Power  off  stall  (gear  and  flaps 
down). 


of  TU-25  contact  objectice  flying  tcalt 

Veriablti  mnivrti 

Manifold  pressure  deviations. 

Manifold  pressure  differences  in  two  engines* 
Climb  above  lead  plane  or  drop  below. 

Lag. 

Crowd  up. 

Total  time. 

Maximum  lag. 

Maximum  lateral  overshoot. 

Over-run  or  crowd  up. 

Lag. 

Climb  above  lead  plane. 

Lateral  error. 

Manifold  pressure  deviations. 

Over-run. 

?  ng. 

Climb. 

Drop. 

Altitude. 

Air  speed. 

Dank. 

Heading  deviations. 

Altitude  changes. 

Time  to  reach  100  m.  p.  h. 

Airspeed  variations. 

Air  speed  deviations. 

Dank. 

Altitude  changes. 

Cylinder  l  ead  temperatures. 

Power  control  and  attitude. 

Uni.-e  gear  nnd  flaps. 

Air  speed  control. 

Heading  deviations. 

Altitude  control. 

Altitude  control. 

Heading  deviations. 

Hate  of  climb. 

Secondary  stall. 

Heading  deviations. 

Altitude  control  at  break  and  recovery. 
Dank. 

Gear  and  flaps  up  during  recovery. 


Trr-'-^^  “  C°n‘°'‘  **-»•**,  ***/« — Continued 

Short  w  Lading.  .ppro«h. 

Air  speed  at  Initial  contact. 

Landing  aone. 

Addition  of  power. 

"Drop  in." 

Where  cut  power. 

Table  A7.2.— Sample  contact  manutur 
Formation— Straight  and  Level 

Lead  plane  climbs  to  5,000  feet  above  the  ground  and  flic  .  a. 
and  level  course.  Student  flics  normal  position  off  rivbf  m  “ght 
plane  should  fly  at  180  m.  p.  h.  with  1  BOO  ”?.ht  ^ 

seconds  for  student  to  adjust  his  nositinn  •  a  ^,°W  ®I8t  3® 
observations  during  the  nevMrluC  Make  «"* 

A.  Manifold  pressuro  left  engine  during: 

Minute? : 

“*  *  3d 


4th 

Inches 

Hg. 


Score: 


Student’ $  to ora 

Deviation 

2  inches 

3  inches 

4  inches 

5  inches 
Over  5  inches 


Points 

(5) 

(4) 

(3) 

(2 ) 
(1) 


ta  m,nif0ld  Pre“u" 

2  inches  or  lesa _ _  /-\ 

3  or  4  inches . . . . 

Over  4  inches . -11111111^11(1) 
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Table  A7.2. — Sample  contact  maneuver — Continued 

C.  How  many  times  did  student  climb  abovo  and/or  drop  below  lead 

plane  by  10  feet  or  more  (approximate  thickness  of  fusclago): 

0  times . (5)  3  times . (2) 

1  time . . __  (4)  4  times  or  moro . (1) 

2  times . . (3) 

D.  Maximum  lag  at  any  time  was: 

Within  X  plane  length .  (5) 

Within  full  plane  length.. . .  (3) 

More  than  one  piano  length . .  (1) 

E.  How  many  times  did  student  crowd  up  so  check  pilot  could  see 

leading  edge  of  left  vertical  stabilizer  of  lead  plane: 

0  times . . (5)  3  times . (2) 

1  time— . . (4)  4  times  or  moro . .  (1) 

2  times _ (3) 


411 


Table  A7.4.  Intercorrelations  of  single-engine  landing,  two-engine  Advance 

training,  first  training  freeze 


Item 

N 

0 

Lined  in  with  runway . 

AT 

0 

0.  S3 

A/S  on  approach  . 

0.  13 
*03 
.03 
-.02 
•.  13 

Was  near  checked 7 . 

p 

.01 

.27 

07 

Where  power  was  cut . 

Q 

Landing  zona  . 

J? 

Lauded  In  skid . 

5 

p 

Q 

R 

s 

*0.73 

a.M 

o.» 

*0.  78 

.  44 

.CO 

.  56 

.51 

.63 

.61 

‘.74 

.03 

j _ r  T 

.04 

.53 

,0i 

.13 

.84 

*.0I 

-.02 

1 

.06 

•Tetrachorlc  correlations. 


Note  on  tables  A7.8  and  A7.4-  These  tables  givo  tho  intcrcorrola- 
tions  of  the  19  measures  and  the  pilot  staninc.  In  tablo  A7.4  aro  tho 
intcrcorrclations  for  tho  six  measures  in  the  single-engino  landing 
maneuver.  None  of  the  coefficients  in  these  two  tables  was  corrected 
for  tho  effect  of  scoring  in  broad  categories. 

The  upper  right-hand  half  of  the  matrix  in  tablo  A7.4  is  based  on 
all  cases  of  class  44-J,  a  total  of  725  cases.  The  lower  left-hand  half 
of  the  matrix  is  based  on  tho  same  group  after  removing  214  cases 
who  all  received  the  same  score  of  “1”  on  all  C  measures  in  this  maneu¬ 
ver  since  they  failed  to  make  a  satisfactory  landing  and  had  to  “go 
around."  It  was  necessary  to  make  this  correction  since  giving  theso 
students  tho  lowest  score  on  all  of  tho  measures  will,  of  course,  increaso 
tho  intcrcorrelation  among  them  and  would  thus  givo  a  false  picturo 
of  the  relations  between  tho  measures  of  the  singlc-cngiho  landing. 
The  uncorrcctcd  values  arc  shown  in  the  upper  right-hand  half  of  tho 
matrix. 


Table  A7.5. — Means  and  standard  deviations  for  the  19  objective  measures  pre¬ 
sented  in  tables  A7.9  and  A7.\ 

AT- 725 


Item 


J. .... 

K. ... 

£.... 

M. ... 

N. ... 

O. ... 

P. ... 

s .... 
r ... 

i/.... 

v.... 

IV... 

X. ... 

Y. ... 
7..... 
AA.. 
DD.. 


Mean 

Standard 

deviation 

2.47 

a  mi 

X  12 

.e.-a 

2  22 

.  7V1 

xri 

,r.s9 

2. 10 

.m 

1.75 

.7  63 

2.00 

.vn 

2.05 

.Vvi 

1  w 

.731 

X  II 

.WU 

102 

.7*5 

2  00 

.377 

2.40 

.M/7 

1.77 

.7*5 

X  30 

.7 A 

l>5 

>01 

2.M 

.457 

X  40 

.014 

2.13 

.7.V 

Mean'  on-!  stand- 
aril  iti’V  1st  tuns  oi¬ 
ler  removing  214 
rowi  w  Ith  rentes 
of  "I." 

A*. 4,  lower  left- 
huii'f  half  of  mo- 
irU.)  .V-Sll 


Miss 


XM 

X07 

151 

2.47 

a.  S3 
x« 


so 


.701 

.mi 

.77* 
.4  *3 
.7*1 


703322— 4T - 28 
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APPENDIX  TO  CHAPTER  EIGHT _ 

Objective  Measures  of 
Multiengine  Flying  Skill 


Table  A8.1. — Mtans  and  sigmas  of  tcoret  by  ehttk  pilots  and  second  observers 
during  the  straight  and  level  course  with  changing  air  speed 

Supplement  to  table  8.1 


' 

Altitude 

Check  pilot 

Second  observer 

It 

M 

SD 

If 

AT 

8D 

Ftri 

mm 

Feet 

Feet 

Time  sample . 

SO 

3M.M 

JO 

404.  45 

30X30 

Ruin . 

CO 

88.73 

*  1 1 

CO 

100.75 

4X80 

80 

6A83 

Hi 

CO 

Ml  75 

2X16 

needing 

Cheek  pilot 

Second  observer 

If 

M 

SD 

If 

A/ 

8D 

Depett 

Deptel 

[kneit 

Degrees 

Time  sample . 

CO 

13  57 

IX  38 

to 

k  at 

11.40 

Ranee . 

CO 

4.03 

X  47 

80 

4.10 

126 

Limits . 

80 

X  78 

1.64 

CO 

187 

Lit 

Table  A8.2. — Means  and  SD's  of  test  and  retest 

Supplement  to  table  8.2 

Altitude  In  steep  turn 


First  turn 

Second  turn 

|  | 

N 

W 

8D 

N 

M 

8D 

S  ,  ■ 

80 

Feet 
tO.  73 

Feet 

41 17 

to 

Feet 

3A  73 

Feet 

27.48 

80 

121.25 

77.18 

to 

W.50 

M.63 

80 

104.73 

6124 

to 

70.68 

41  SO 

Heading  In  straight  and  level  course 

1-2  legs 

2-4  legs 

If 

M 

SD 

N 

*  ! 

1  SD 

Tim®  i&mpU . . . . . 

80 

Deteeet 

7.10 

Depeet 

7  10 

to 

Depeet 

A  23 

“Tu 

Rftngi _ 1 . . . . . 

60 

140 

XU 

to 

*  J>7 

1.70 

Limits . 

CO 

135 

1.45 

to 

1)0 

L2S 

Table  A8.2. — Means  and  SD’s  of  test  and  retest — Continued 
Supplement  to  table  8.2 

Alt  tude  In  straight  and  level  cou m 


Table  A 8.3. — Meant  and  SD't  of  the  objective  mtaturtt  for  the  two  criterion  groups 

Supplement  to  table  8.3 


Low  Group 


Rang# 

Limit 

Tbnesampto 

D 

a 

SD 

□ 

M 

SD 

N 

M 

8D 

Altitude  deviation  In  ilrep  turn 
(In  feel)  .......  .  ..  , 

30 

218.00 

122  48 

30 

211.83 

107. 31 

30 

11178 

61  li 

Altitude  deviation  ttralgbt  and 
level  (In  feet) . . 

30 

121.83 

38.01 

30 

71  SO 

20.99 

30 

437.00 

189.13 

Heading  straight  and  level  (In  do- 
greee) . 

30 

1 80 

Tea 

30 

187 

1.31 

30 

17.87 

111* 

High  Group 


Altitude  In  steep  turn  (In  feet) 

30 

183.  SO 

8147 

30 

136.83 

7111 

30 

8117 

48.84 

Altitude  In  straight  and  level  (In 

(ret)  .  ...  .  - 

30 

>7.67 

i:.C2 

30 

63  00 

32.  83 

30 

n.oo 

209  84 

Heading  In  straight  and  level  (In 

degrees) . 

30 

140 

1.91 

10 

147 

L  36 

30 

iaoo 

17* 

Table  A8.4. — Compaction  of  the  total  of  four  part  scores  with  the  tingle  score  based 
on  the  largest  dictation  during  the  straight  and  level  course  vith  changing  air 
speeds 

A.  Observer  reliability  (N=*60) 


- 

Range 

Limit* 

Second  cb* 

HfVtf 

Check  pilot 

B 

Second  ob¬ 
server 

Check  pOot 

r 

.V 

SD 

.V 

SD 

.\t 

SD 

A/ 

8D 

(Degree* 

■ 

m 

rj 

Beading: 

deviation) 

Total  score . 

7.7 

3.0 

Ul 

3.4 

a  43 

3.4 

3.6 

10 

a  si 

Single  aeon . 

11 

21 

10  1 

23 

.36 

27 

1.4 

21 

L3 

.34 

(Feet 

Altitude: 

deviation) 

Total  (core . 

220 

I  81 

139 

88 

.63 

147 

59 

114 

62 

.73 

Single  icon . 

no 

43 

| 

87 

48 

.69 

69 

28 

39 

33 

.79 

416 


Tapi  t  AS.  4.  Co  n/>irt  .«,•*»)  of  the  total  of  four  pa't  *co~tt  i.-t*\  t\t  tin;'e  teere  Sjjrd 
on  tr,c  \arittt  deriotion  during  the  straight  on  J  l ere l  course  with  chaucir.g  air 
s;c  it— Continued  *  * 


n.  Twl*rpto.<t  reliability 


1 

1 

1 

j  i -2 lrc* 

3-4)00 

r 

1-3WI 

3-41*0 

r 

M 

1  SD 

Sf 

SD 

.V 

SD 

st 

SD 

llMd'r.F  (<1opTW*): 

T.  til  s»vre . 

1  3 

xo 

17 

IS 

ao 

10 

1.9 

10 

10 

a» 

Sir;'.*  Kvr* . 

1 ; 

14 

19 

l.S 

.SO 

14 

l.S 

11 

LS 

.:s 

Altitude  t(pfi): 

Total  rwr* . 

in 

M 

93 

47 

.s: 

S3 

40 

■1 

» 

.  J4 

£lct>Kor* . 

91 

X 

•  t 

34 

.  a 

61 

m 

M 

.61 

C.  Validity  cooflicienta 


Low  croup 

High  croup 

1 

Low  croup  | 

lll(h  croup 

.V-30 

.v-so 

r*w 

.V-30  | 

.V-30 

M* 

M 

SD 

St 

SD 

M 

SD 

.V 

SD 

Beading  (decree*): 

■■ 

■ 

IS 

&1« 

Total  score . 

9.3 

11 

6.4 

m 

19 

10 

19 

Slr.f!r  Kor» . 

4lS 

14 

14 

1.9 

.31 

19 

13 

IS 

1.3 

.W 

Altitude  (feet): 

.u 

Total  *oor* . 

:« 

72 

199 

S4 

.26 

15* 

■  I 

137 

6S 

Sine)*  score . 

122 

XS 

99 

44 

.a 

m 

14 

6J 

S3 

.30 

Table  AS.S.—TB-S5  Instrument  flight  check 
(For  research  purpose*  only) 


Date  .  Time  of  flight . 

Name  of  student . . . 

(Last  name  first) 

Name  of  instructor . . . 

Class  . .  Squadron _  Flight . 

Total  TB-25  Time _  Inst,  dual -  Inst,  solo — 

A.  Instrument  Take-Off: 

1.  Did  instructor  help  to  keep  aircraft  on  runway 

jrj  during  roll?  . Yes  . -No 

2.  After  take-off  did  aircraft 

....  lose  altitude 

_ level  out  _ climb  too  steeply 

_ maintain  steady  climb 

3.  A/S  range  (grade  from  time  1C5  m.  p.  h.  reached 

to  4,000  ft.  Place  mark  at  lowest  and  highest 
A/S): 


-JLJ 
JL* 
JL*4 
_JL_H 
JL7 
_JLH 
_ II _ 10 


JLW 
_ ILn 


JL* 

JL* 
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Table  A8.5. — TD-tB  instrument  /tight  cheek — Continued 


B.  Climb: 

During  climb  to  7,000  ft.  mark  lowest  and  highest 
A/S  and  levels  of  turbulence: 


BELOW 

ISO  160 

170  160 

ABOVE 

t4S 

1  i  1 

.lil 

165 

D.  CLIMB 

During  climb  to  7000  ft.  mark  love*t  aiA  hi  ghost 
A/S  and  level*  of  turbulence: 

A/S  Turbulonco 


4000  to 
5000  ft. 


ISO  160 

170  180 

Lt. 

Mod. 

Sot. 

lil. 

1  .  1 

5000  to 
6000  ft. 


6000  to 
7000  ft. 


ISO  160 

170 

160 

Lt. 

Mod. 

Sot. 

r  i  i i 

_L 

j_L 

ISO  1 

JLl- 

io  r 

-1-1 

70  160 

_ L—l _ 

Lt. 

Mod. |  Sot. 
_ 1 _ 

JL» 

JL* 

JL* 

JL* 

JL* 


JL« 

Jl _ * 

JL« 

JL* 

JL« 


JL-** 

Jl _ " 

JL,* 

Jl _ * 

Jl _ ** 

JL* 


_JL“ 

_JLW 

_JI _ u 

— Jl _ * 

_JL* 

-Jl _ ® 

_JL» 

-Jl _ » 

_JL* 
_JL» 
-JL* 
JL» 
_JI _ * 


C.  Level  Out: 

"Lovcl  out  at . ft.  Maintain  rollout  heading  and 

altitudo.” — Student  doviated  from  “lovcl  out”  heading  and 
altitudo  by:  (mark  lowest  and  highest  deviations).  For  one 
minuto. 


_JL« 

_JL* 
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Table  A8.5. — T3-25  I  nitrument  flight  cheek — Continued 

F.  Power  Let-down  (Basic)  (Radio): 

“Fly  at  180  m.  p.  h.,  1,800  r.  p.  m.,  sot  D/G  on  0®. 
Prcparo  for  power  letdown,  GUMP,  using  2200 
r.  p.  m.,  gear  down,  15®  flaps  and  160  m.  p.  h. 
Hold  heading  and  altitude.” 

1.  During  change  of  A/S: 
a.  Heading  and  altitude  deviations: 


_JL_* 

_Jl_* 

JL* 


b.  Did  student  complete  GUMP  che&k? 

. Yes  . No 

“Let  down  500  feet  from  starting  altitude  and  then 
lovcl  out.  Hold  heading  and  160  m.  p.  h.  after 
lovcl  out.” 

2.  Lovcl  out  (from  first  application  of  power): 

Heading,  nltitudc  and  A/S  deviations  during  the 
next  minute: 


JL» 

JL« 

JL« 


140  ISO  160  170  ISO 


Tablk  A8.5. — TD-25  Instrument  /tight  theek — Continued 

G.  SiNcr.K-ExciN'K  Operation: 

“Fly  at  1,800  r.  p.  nt.,  180  m.  p.  li.  normal  cruiso. 
Set  D/G  on  0°.  I  am  going  to  cut  a  throttlo  and 
you  arc  to  set  up  a  single-engine  proccduro  holding 
heading  and  altitude.  Maintain  safo  single-engine 
A/S." — (Tako  all  readings  from  throttlo  cut  to  1 
minute  after). 


Heading 


Lowest  A/S  reached: 


m.  p.  h. 


-JL-« 

JL» 

JLM 


H.  Radio  Procedure: 

Did  student: 

a.  Tunc  in  and  identify  proper  station? 

. Yes  . No 

b.  Check  d/g  against  magnetic  compass  and  reset? 

. Yes  . No 

During  1st  minute,  deviations  while  tuning  radio 
equipment: 


_JL_« 

_JL_* 

_ II _ w 

_ II _ 

_ II _ 45 


I.  Quadrant  Identification: 

Did  student  rccognizo  fado  or  build  correctly? 
. Yes  . No 

J.  Beam  Crossino: 

After  crossing  through  beam,  did  student  start  his 
turn  in: 

. 4  signals  or  less 

. .  8  signals  or  less 

. . 12  signals  or  less 

. moro  than  12  signals 


-JL-” 

_Jl_* 
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Table  A8.5. — TD-S5  Intlrument  flight  check — Continued 

K.  Station  Identification  : 

Position  when  student  signaled  ho  passed  station: 


Seconds  ||  n 


i~  -;• - - 

_ II _ * 

50  40  b>  60 

L.  Let-down  and  Low  Approach: 

a.  Position  when  student  signaled  "over  field": 

. within  field  boundary  || _ * 

. within  1  milo  of  field  _ 1 1 _ w 

. within  2  miles  of  field 

. over  2  miles  from  field 

b.  Time  error  from  low  cone  to  field  boundary; 

. . see. 

M.  Voice  Procedure:  .  _ II _ ' 

Did  student  use  voico  procedure  correctly? 

. Yes  _ No 


_ IL." 

_JL_" 

_ji_* 

_ II _ W 

Table  A8.6. — Mean,  sigma  and  reliability  of  each  objective  measure  in  the  TB-Z5 

daily  check  ride 

(Based  on  scores  of  average  odd  and  average  even  trials  for  double  length) 


Means 

Standard 

deviation 

Reliability 

coefficient 

J>» 

iV 

Odd 

Even 

Odd 

Even 

Uncor- 
reeled  > 

□ 

A.  Instrument  Tari  orr 

1.  Instructor  help  keep  on  runway . 

2.  Attitude  In  Initial  climb . . 

OS 

ZOO 

1.87 

0.82 

0.84 

0  03 

0.00 

&4C 

70 

3. 19 

122 

1.39 

1.34 

.13 

.26 

.11 

3.  Air  speed  range  in  climb  to  4,000  feet . 

72 

3.29 

127 

.93 

.86 

.17 

.29 

.08 

D.  eruiAL  rum: 

4.  Air  simmI  In  climb  4,000-5,000  feet... . 

74 

3.30 

133 

.71 

.70 

-.12 

-.21 

5,  Air  .ijmhM  In  climb  A,fti0-A,fl00  feet.  .  .... 

73 

3. 60 

ICO 

.71 

.71 

—  01 

—.02 

6.  Air  speed  In  climb  6jOOO-7,OQO  feet . 

73 

3.75 

191 

.70 

.63 

.09 

.17 

.23 

0.  Laval  Cot: 

7.  Heading  during  level  out . 

70 

103 

104 

.71 

.70 

.24 

.39 

.02 

S.  Altitude  during  level  out . 

78 

3.57 

3.62 

.73 

.78 

.32 

.48 

.01 

D.  ISO*  Turn: 

.23 

9.  Time  error  In  180*  tum . 

77 

2.44 

Z  52 

.60 

.46 

.09 

.17 

10.  Altitude  range  In  ISO*  tum . 

77 

3.09 

112 

.77 

.83 

.47 

.64 

.01 

77 

123 

140 

.77 

.70 

-.04 

-.  10 

E.  Partial  Panel  Turn: 

12.  Time  error  In  partial  panel  lum . 

77 

Z  79 

Z  73 

.38 

.33 

.08 

.18 

.21 

13.  Altitude  range  In  partial  panel  turn . 

73 

Z  64 

Z  84 

.92 

.80 

.30 

.86 

.01 

It.  Heading  nt  roll-out  In  partial  panel  tum . 

77 

ZC2 

Z  66 

1.13 

1.04 

.08 

.13 

.23 

F.  Power  Let  Down: 

13.  Heading  range  during  A/3  change . 

71 

141 

130 

1.00 

.83 

.18 

.31 

.07 

IS,  Altitude  rouge  during  A/3  change . 

76 

Z  60 

Z  77 

.8* 

.97 

.14 

.23 

.13 

17.  l)ld  student  complete  UUMPcbcckT _ 

78 

Z  66 

Z  39 

.86 

.73 

.13 

.26 

.11 

IS.  Heading  rongo  nt  level  out . 

71 

4.03 

199 

.73 

.63 

.22 

.36 

.03 

19.  All llude  range  nt  level  out . 

30.  A/S  range  at  level  out . 

76 

184 

188 

.72 

.80 

.32 

.48 

.01 

7« 

1SS 

1C9 

.74 

.09 

.11 

.23 

.14 

8m  footnotes  at  end  of  table. 
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Tabi-e  A8.6.  }fean,  sigma  and  reliability  of  each  objective  measure  in  the  TD-15 

daily  check  ride — Continued 


■ 


o.  Singie-Encine  Operation: 

21.  Heading  range  during  8.  E.  operation _ 

22.  Altitude  range  during  S.  E.  o|>crRtlon _ 

23.  Lowest  A/3  reached  during  S.  K.  opera¬ 

tion  . 

n.  Radio  Procedure: 

24.  Tune  In  and  idcntl/jr  proper  station . 

23  Check  directional  gyro. ...  ...  . 

2d.  Heading  range  while  tuning  radio . 

27.  Altitude  range  while  tuning  radio . 

23.  A/S  rango  while  tuning  radio . 

I.  Quadhant  Identification: 

29.  Recognize  fade  or  build  . 

J.  Beam  Crossino: 

30.  When  started  turn  after  crossing  beam... 

K.  Station  Recognition: 

31.  Error  In  seconds  when  crossed  cone . 

L.  Let-Down  and  Low  Approach: 

32.  Position  when  signaled  over  field  In  let¬ 

down . 

33.  Time  error  of  let-down  from  cone  to  field 

M.  Voice  Procedure: 

34.  Use  proper  voice  procedure . 


N 

Means 

Standard 

deviation 

Reliability  1 
Coefficient  | 

P  * 

Odd 

Even 

Odd 

Even 

Uneor- 

reeled' 

! 

m 

75 

3.01 

195 

.00 

.87 

.12 

.31 

.16 

75 

160 

143 

1.08 

1.04 

.30 

.83 

.08 

72 

136 

134 

.78 

.71 

m2 

.31 

.87 

67 

106 

104 

.27 

.28 

-.03 

-.06 

GC 

130 

120 

.73 

81 

.30 

.M 

.01 

61 

3.  OR 

109 

.74 

.72 

-.03 

-.06 

63 

3.43 

172 

.07 

.03 

.21 

.35 

.03 

GO 

180 

101 

.02 

.88 

.09 

.17 

.33 

61 

1 75 

161 

.68 

.46 

.33 

.30 

.01 

66 

161 

162 

.36 

.66 

-.18 

-.16 

37 

4.01 

101 

l.tl 

1.34 

.33 

.37 

.04 

27 

4.83 

4. 48 

.32 

.88 

-.17 

-.29 

20 

110 

1.33 

.59 

.32 

.06 

.11 

.38 

16 

131 

131 

.03 

.03 

.13 

.13 

.» 

i  Uncorrcctcd  reliability  coefficients  are  cnlculated  from  the  avenge  of  odd-day  ride  scores  and  the  aver* 
age  of  even-day  ride  scores.  The  actual  test  was  a  combination  of  both,  or  twice  as  long  as  the  tests  repre¬ 
sented  by  each  of  these  averrges.  The  corrected  reliability  coefficients  allow  for  the  Increased  reliability 
of  the  full-length  test,  as  compared  with  the  half-length  tc.-t  from  which  the  uncorrrclcd  coefficients  wera 
derived. 

*  The  probability  of  obtaining  by  chance  positive,  unoorrccted  correlations  of  tbe  size  observed. 


Table  A8.7. — Semi-partial  correlations  to  correct  for  differences  in  amount  of  total 
TB-25  flying  time  on  the  odd  ».  the  even  days 


Measure 

Unconrcted 

odd-even- 

reliability 

Semi-part  tal 
correlation 

ao> 

.si 

.18 

a  13 

.38 

.16 

_ru  —  ^Jt^lt- P?3f,ii*f"*’tA,‘?4f»i  1 

r"  - 7T=rWi-*. 

ria=odd  score,  even  score. 
rI4=odd  scoro,  even  hours. 
r24=cvcn  score,  even  hours. 
ru=odd  score,  odd  hours. 
r3J=:cvcn  scoro,  odd  hours. 
r»4=odd  hours,  even  hours. 

■  Oullford,  J.  P..  Psychometric  .VcfAoJr,  p.  401,  McOraw-BIII  Book  Co.,  Ine,  N-  Y.,  1931 
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Table  A8.8. — TB-tS  I nitrument  flight  cheek  ( AAF  BO-3)  1 

Date . .  Squadron.. .  Flight _ 

Name  of  student . 

Name  of  check  pilot . . . . . . . 

Total  TB-25  time .  Instrument  dual . . . 

Instrument  solo . . . . . 

Instructions:  Scoro  each  measure  as  it  occurs.  If  the  student  fails 
any  one  or  moro  maneuvers,  ho  has  not  passed  this  50-3  check  ride. 
Appropriate  remarks  will  bo  mado  in  these  cases.  Detcrmino  the  total 
scoro  for  those  students  that  pass  all  maneuvers  in  tho  check  ride. 

Summary  of  Student’s  Ride:  The  numerical  score  is  the  sum  of  all 
measures.  Tho  radio  rango  scores  are  added  together  and  multiplied 
by  two  thus  giving  tho  basic  and  radio  phases  approximately  equal 
weight  in  the  total  score.  Tho  check  pilot  should  write  a  short 
descriptive  statement  pointing  out  tho  strong  and  the  weak  aspects  of 
tho  student’s  instrument  flying  Rkill  as  demonstrated  on  this  ride. 
Frequent  reference  can  be  mado  to  the  maneuvers  (indicated  by  letters 
A  through  S). 

Sum  or  Scouts 

Basie  Instruments:  Radio  instruments: 


Pago  2 .. 
Pago  3 .. 
Pago  4  . . 
Pago  5 . . 
Total  . 

Pago  8  . 
Pago  7  . 

Total 

Grand  total . 

. X2« 

.  Letter  grade 

- . 

A 

B  „ 

C 

D 

E 

Superior 
(over  500) 

Excellent 

(400-500) 

Very  satisfactory 
(300-309) 

Satisfactory 

(200-299) 

Fail 

(below  200 
or  fail  one 
or  more 
maneuvers) 

Comments: 


A.  Cockpit  Check:  3.  complete. 

1.  omitted. 

B.  Instrument  Take-Off: 

Directional  control  during  roll: 
5.  Satisfactory. 

3.  Needed  a  little  help. 

1.  Instructor  took  over. 


2.  incomplete. 


Takc-ofF  attitude: 
3.  Normal. 

1.  Noso  high. 
1 .  Noso  low. 


i  The  specific  condition*  used  In  tb«  check  represent  tbotc  used  at  one  Adruced  two-engtM  school  (Sold 
Army  Air  Field,  Sold,  Okla). 
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Taule  A8.8. — TD-55  Instrument  flight  check  (AAP  60-3)- Continued 

Deviations  after  1G0  miles  per  hour  first  reached  and  until  start  of 
spiral  climb: 

_ Heading _  _ Mr  speed _ 

10  o  io  iso  ico  no 

I  1  I  I  I  I  i  ll  11  Pa». 

135531  135531  ....  Fail. 

C.  Spiral  Climb:  Reverse  direction  of  turn  every  500  feet  during  tho 
first  2,000  feet  of  climb. 


Turbulonco 


Mod. 


Turbulcnco 


First  1,000  feet  of  climb: 

_ Air  speed 

150  ICO  170 

I  i  I  i  I 

1  3  5  6  3  1 

Second  1,000  feet  of  climb: 

_ Air  speed _ 

I  150  1GO  170 


1  3  5  5  3  1  Lt.  Mod.  Scv. 

During  entire  climb  to  lovel  out: 

Trim  control . :  3.  Satisfactory.  1.  Unsatisfactory. 

Control  of  power _ :  3.  Satisfactory.  1.  Unsatisfactory. 

Tccliniquo  at  tho  controls: 

5.  Generally  smooth. 

3.  Sometimes  smooth,  sometimes  rough. 

1.  Generally  rough.  - Pass. 

....  Fail. 

Sum  of  scores  on  this  pa  go  (2) . 

Comments: . . . . . . . . 


D.  Level  Out:  “Level  out  at _ feet.  Maintain  level  out  altitude 

and  heading  of _ °”.  G ratio  for  2  minutes  after  start  of  lovel  out. 


_ Heading _ 

10  0  10 

III.! 

1  3  5  5  3  1 


too 


E.  Pattern  A  (restricted  pond): 
First  turn  and  leg: 


10 

1 

1  3 


Heading 

0 

i  l  ■ 

5  5 


Time  error:  3 


10 

I 

3  1 
1 


Trim  control: 

3.  Satisfactory. 

1.  Uimtisfactory. 


r  50  50  X 

too  kx5\  , 

Alt.  > 

Roll  out  error:  5 


Score  UtnlU: 

Time  error  In  turn: 

3  for:  Within  3  itconda, 
I  (or:  Orel  3  rcoooJj. 
Roll  out  hr<vllni: 

S  for:  Within  1*. 

3  for:  Within  10*. 

1  for:  Orer  10*. 
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Table  A8.8. — TBS5  Imtrument  flight  cheek  (AAF  SOS) — Continued 


Second  leg  and  turn: 


Timo  error:  3  1  Heading  at  roll  out:  5  3  1 


Third  leg  and  turn: 


Timo  error:  3  1  Roll  out  heading  error:  5  3  1 


Fourth  leg  and  turn: 


Timo  error:  3  1  Roll  out  heading  error:  5  3  1 


Throughout  pattern:  Technique  Cross-checking: 

3.  Satisfactory.  3.  Satisfactory. 

1.  Unsatisfactory.  1.  T  ^satisfactory 

Sum  of  scores  on  this  page  (3) . Pass.  Fail _ 


F.  Pattern  B: 

Seoret 

_ 5 _ 3 _ 1_ 

Ilcnding . .  5°.  10#.  Over  10®. 

Altitude .  50  feet.  100  feet.  Over  100  feet. 

Airspeed .........  5  miles  per  10  miles  per  Over  10  miles 

hour.  hour.  per  hour. 

Time  error . .  5  seconds. _ 10  seconds.  Over  10  seconds. 

First  leg:  Heading  Altitude  Air  speed 

5  3  1  5  3  1  5  3  1 

First  turn:  Altitude  Air  speed  Roll  out  Timo  error 

531  53  1  531  531 

Second  leg:  Heading  Altitude  Airspeed 


5  3  1  5  3  1  5  3  1 

Second  turn:  Altitude  Air  speed  Roll  out  Time  error 

531  53  1531  531 

Tliird  leg:  Heading  Altitude  Air  speed 

5  3  1  5  3  1  5  3  1 

Third  turn:  Altitude  Airspeed  Rollout 

5  3  1  5  3  1  5  3  1 


426 


Timo  error 
5  3  1 


Tahle  A8.8.  TB--25  Instrument  flight  check  (AAF  60-S) — Continued 

Fourth  leg:  Heading  Altitude  Airspeed 
5  3  1  5  3  1  5  3  1 

Fourth  turn:  Altitude  Airspeed  Rollout  Time  error 

5  3  1  5  3  1  5  3  1  5  3  1 

Control  technique: 

3.  Generally  smooth. 

2.  Sometimes  smooth,  sometimes  rough.  _ Pass. 

1.  Generally  rough.  _ Fail. 


G.  Single-Engine  Operation: 

Heading 


1  2  3  5  5  3  2  1 

Maintain  safe  single-engine  airspeed:  5. 
Procedure: 


5.  Correct  and  safo. 

3.  Correct  but  hesitant. 

2.  Incorrect  but  safo. 

1.  Incorrect  and  possibly  dangerous. 

_ Pass. 

Sum  of  scores  on  this  page  (4) .  . Fail. 


H.  Steep  Turns: 

Maintained  constant 

angle  of  bank . 

Held  ball  in  center... 

Control  technique... 

Restricted  panel: 

Maintained  constant 

angle  of  bank . :  3.  Yes.  1.  No. 

Held  ball  in  center...:  3.  Yes.  1.  No. 

Control  technique _ :  3.  Smooth.  1.  Hough. 

_ I  Vs. 

_ Fail. 

I.  Stalls  (write  in  typo  of  stall . ): 

Maintained  constant  approach..:  3.  Yes.  1.  No. 

Recognized  stall  condition.. _ :  3.  Satisfactory.  1.  Poor. 

Recovery: 

Initial  recovery  attitude. . :  3.  Normal.  1.  No*c  low.  1.  No-c  high. 

Applied  power . :  3.  At  about  right  time.  1.  Too  soon. 

Amount  of  altitude  lost...:  3.  Normal.  1.  Kxccmive. 

Control  of  piano  was . :  3.  Smooth.  1.  Hough. 

_ IV*. 

.  .  ....  Fail. 
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Tahle  A8.8. — TD-25  Ir.tlrumtni  flight  check  (AAP  60-3) — Continued 

J.  Unusual  Position  Recovery: 

Start  of  recovery  was . :  3.  Immediate.  1.  Hesitant. 

First  recovery  action  was..:  3.  Correct.  1.  Incorrect. 

In  general,  recovery  was...: 

3.  Smooth  and  safe. 

2.  Rough  but  safe. 

1.  Dangerous  but  recovered  without  help. 

1.  Instructor  had  to  assist  recovery. 

....  Pass. 

Sum  of  scores  on  this  page  (5)  ..........  ....  Fall. 

Comments: _ _ _ _ _ _ 


Radio  check 

K.  Procedures: 

Properly  tuned  in  desired  station _ :  5.  Yes.  1.  No. 

Check  D/G  against  magnetic  and  reset... . :  5.  Yea.  1.  No. 

Turn  to  correct  bisector  heading  (10°) . :  6.  5*. 

Rccognizo  fado  or  build:  3.  10*. 

5.  Within  5  minutes.  1.  Over  10*. 

3.  Within  10  minutes. 

1.  Over  10  minutes  or  dono  Incorrectly.  Control  of  altitude 


L.  Orientation: 

Recognized  chango  of  signal . :  5.  Satisfactory. 

1.  Unsatisfactory. 

Procedure: 

5.  Selected  best  system  and  did  it  correctly. 

3.  Selected  less  desirable  system  but  did  it  correctly. 

1.  Failed  to  properly  orient  himself. 

Remirks: . . . . . . . . .Pass. 

. Fail. 


M.  Beam  Followino: 

Check  D/G  and  reset. ... _ :  5.  Yea.  1.  No. 

Mako  noccssnry  corrections  to 

follow  beam _ _ :  5.  Yes.  1.  No. 

Station  recognition _ :  5.  Satisfactory. 

1.  Unsatisfactory. 

_ _  Signal  interference. 


Control  of  altitude: 


Remarks: 


Pass. 

Fail. 
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Table  A8 .8.-TB-25  Instrument  flight  cheek  (AAF  50-S)—  Continued 
N.  Holding: 

Make  necessary  corrections  to  follow  beam..:  5.  Yes.  1.  No. 
Direction  of  procedure  turn . .  5.  Correct. 

r>  *  *  *  ....  .  !•  Incorrect. 

Control  of  altitudo: 


Sum  of  scores  on  this  page  (8) 

C.  Let-Down:  During  change  of  air  speed,  did  student 

Chango  props  to  2,200  r.  p.  m . :  3.  Yes.  1.  No. 

Lower  gear  (under  170  m.  p.  h.) . .  3.  Yos.  1.  No! 

Complete  GUMP  check . . . . ;  3_  Yes.  I.  No. 

Make  radio  call . :  3.  Yes.  1.  No. 

Altitudo 

Heading  a  * 


10 

I 


10 


I  I  I  I 


1  3  5  5  3 

Remarks: . 


i  .A°°  >oo\, 

1  Alt.  1 


Air  sicced 


150  1G0  170 

J  I  1  I  I 


3  5  5  3  1 


P.  Procedure  Turn: 

Timo  from  station:  5.  Correct.  1.  Incorrect. 

Was  procedure  turn  done  properly:  5.  Yes.  1.  No. 

_ Air  upccd 


Pass. 

Fall. 


150 


J _ L 


100  170 


1 


Remarks: 


Q.  Indound  to  Low  Cone:  Altitudo 

Air  speed  I  "V 

1 - TTTi  /so  6  so\ 


Pass. 

FaiL 


-10 

I  I  I  » 


I 


I  I  ,^lOO  »00^ 


Recognized  low  cone 


20  10  0  0  10  >0 

~l  1  1  1  1  1  I  1  1  1 


See. 


1 


Pass. 


Remarks: 


am 


Table  A8.8. — TD-S5  Instrument  flight  cheek  (AAP  60S) — Continued 


Timo  error: 

6.  Within  5  seconds. 

3.  Within  10  seconds. 

1.  Over  10  seconds. 

Altitude  when  signaled  over  the  field: 

Position  over  tho  field: 

5.  Very  accurate  approach. 

3.  Safe  distance. 

1.  Too  far  for  safety. 

Item  arks:  . .. . . . ; _ _ _ _ _ _  _ Pass. 

. . Fall. 


R.  Low  Approach: 
_ Air  speed 


-10  0 

+  10 

— J _ L  .  1 

1  1 

1  3  5  5  3  1 


S.  Emergency  Poll-Up: 

Add  power . :  5.  Yes.  1.  No. 

Rotract  gear . 5.  Yes.  1.  No. 

Heading  and  A/S  deviations  for  1  minute  after  adding  power: 


1  3  5  5  3  1 

Sum  of  scores  on  this  pogo  (7)  . . . 


Heading 


10 

0 

10 

1  . 

1 

1  1 

1  3  5  5  3  1 


Air  speed 


150 

160  170 

1  i 

1  ■  1 

Table  A8.0. — Inventory  of  objective  measures  of  TB-H  instrument  flying  skill 


Inventory:  TD-24  Instrument  seal* 

Number 
of  meai> 
urc* 

Inventory:  TB-24  Instrument  seal* 

Number 
of  mess* 
ures 

A.  Instrument  take-ofi . 

A 

M.  Radio  compass  (position  report. 

B.  Spiral  climb . 

s 

tracking,  boilnr,  Intersectlnf 

O.  Lcvrl  out  on  miking  Altitude.  •• 

3 

u 

4 

K  Engine  out,  partial  panel . . ... 

10 

V.  Tiino  turns:  3tU*...I _ 

10 

O.  FUt|»  turns:  300* . . . 

12 

to 

I.  Slow  Hying _ _ _ 

14 

J.  Power 'on  still . 

4 

3 

Is,  Tnio  fade. _ _ _ _ 

4 

Total . 

in 

430 


Table  A8.10. — Tiro  sample  instrument  muneurert  for  the  Tli-t4 

H.  Partial  Panel  Turn:  270°: 

“Cage  both  gyros.  Do  a  partial  panel  standard  rato  timo  turn  of 
270°  to  the  (right)  (left).  Start  the  turn  from  any  cardinal  heading  of 
the  magnetic  compass,  and  the  time  on  any  cardinal  heading  of  the 
clock." 

1.  Altitude  deviations:  Grade  from  start  of  turn  to  level  flight. 


2.  Heading  deviation:  At  roll  out. 


10 

0 

10 

Over 

_ ! 

I  1  , 

1 

1  1_J_ 

20 

3.  Did  student:  Use  correct  calibrated  time  for  this  amount  of  turn? 

Yes....  (3).  No - (l). 

M.  Radio  Compass: 

4.  Time  check:  (Complete  instructions  before  reaching  wing  tip 
position  or..  R/C)  “As  soon  as  the  R/C  is  exactly  on  wing  tip  position, 
turn  inbound  on  the  bearing  of  (33°)  (123°)  (213°)  (303°). 

a.  Did  student  signal  time  within  ±  15  seconds  of  instructor’s  time? 

Yes....  (3).  No - (1). 

b.  Instructor’s  time  to  station: - minutes  ....  seconds. 

5.  Heading  and  RjC  deviations:  Grade  after  in-bound  turn  is 
completed. 


Heading 


APPENDIX  10  CHAPTER  NINE 


Objective  Measures  of  Single- 
Engine  Instrument  Flying 
Skill  at  tbe  Basic  Level  of 
Flying  Training 


BASIC  INSTRUMENT  FLIGHT  CHECK  (AT-6) 

For  Itcsmch  Purposci  Only 
(Form  12) 

Date .  Take-Off  Time . 

Student .  ASN . 

Class .  Squadron .  Group . 

Total  AT-6  Time _ Inst.  Dual - Inst.  Solo - 

Regular  Instr.  Instructor . 

Check  Pilot . - . 

Stanincs:  B _  N -  BP -  FP - FE - 

Quartilo  Rating .  Rank  Order . - 


This  test  is  being  administered  for  research  purposes  iT 

only.  Scores  on  this  booklet  will  not  affect  the  final  „ 

instrument  grade  nor  will  it  influence  futuro  assign-  _ » 

inents.  All  test  scores  will  be  handled  as  a  group  and  no  - » 


comparisons  will  be  made  between  individual  students  or 
individual  instructors. 


,1 

X  2(1.1) 

.4 

X*  ■ 

.7.  • 

Jt 

.10,  II 
.12.  IS 
.14 
.It 


To  the  Student:  You  arc  familiar  with  nil  of  tho  maneuvers  in  this 
booklet.  Your  score  will  depend  upon  how  well  you  control  heading, 
altitude,  air  speed,  and  time  during  each  maneuver. 


Point  score . .  5  4  3  2  1 

Heading  range - 5°  10  15  20  Over  20. 

A/S  range.. _ ...  -  5  tn.p.h  10  15  20  Over  20. 

Altitude  range.... _ _  50  ft  100  150  200  Over  200. 

Time  range . . -  3  sco  8  0  12  Over  12. 


Your  point  scores  for  altitude,  heat'mg,  etc.,  in  each  maneuver  will  be 
combined  ns  shown  in  the  following  table  to  givo  you  a  single  score  for 
each  maneuver.  In  order  to  make  your  best  score,  you  must  carefully 
control  all  parts  of  each  maneuver,  ns  a  single  low  score  will  give  you 
a  low  score  for  the  maneuver. 
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Heading 

6  4  3  3  1 

6  5  6  4  3  2 

4  5  4  3  3  2  Maneuver 

Altitude  3  4  3  3  2  1  Scoret 

3  3  3  2  2  1 

12  2  111 

To  the  Check  Pilot:  Tho  success  of  the  experiment  will  depend  upon 
how  carefully  tho  booklets  are  scored.  Mark  tho  student’s  deviations 
as  carefully  and  immediately  as  you  can.  If  you  miss  a  measure,  do 
not  guess.  Cross  it  out  and  go  on  to  tho  next. 

Keep  a  Sharp  Lookout  for  Other  Aircraft! 

A.  Instrument  Take-Off:  (Grade  from  start  of  roll  to  700  feet 
indicated). 


3.  Did  student  mako  take-off  without  ANY  help  from  instructor? 
(3) - yes  (1) - no. 

(At  700  fcot  havo  student  break  traffic  and  climb  to  2,500  feet  before 
continuing  check.) 
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.  Climbing  Turns:  (At  2,500  feet  read:)  “Climb  straight  ahead  and 
set  the  D/G  on  0°.  At  3,000  feet  begin  a  climbing  turn  to  tho 
right  holding  15°  of  bank  and  1 10  m.  p.  h.  Roll  out  on  a  heading 
of  180°  and  continuo  climb  straight  ahead  for  ono  minute.” 


OVER  120  no  100  UHOCR 

125  I  .  I  I  I  95 


OF 


□  » 


MEADWt- 


UNDE6 

95 


"NOW  BEGIN  A  CLIMBING  TURN  TO  THE  LEFT  HOLDING 
15°  OP  BANK  AND  110  ITH.  ROLLOUT  ON  A  HEADING 
OP  0°  AND  CONTINUE  CLIMB  STRAIGHT  AHEAD  FOR 
ORE  MINUTE." 


□» 


A/5 

OV?.R  120  »K>  lOOluWXi 

K*  I  I  i  I  I  05 


A/5 

over]  iio  v<o  too  |v»m 
1*5  I  .  I  |  I  95 


r  is 7. 


I  *  ■  »  I  ■  * 

(continue  climb  na  desired  to  working  alt.) 


CL* 


C.  Level  Out:  “Level  out  at _ ft.  Establish  130  m.  p.  h.  at 

1,800  r.  p.  ra.”  (Grade  from  start  of  level  out  for  one  minute.) 


D.  Steep  Turns:  “Set  D/G  on  0°.  Now  do  a  steep  turn  to  tho  right 
with  45°  of  bank.  Roll  out  on  a  heading  of  180°.  Use  power  if 
needed  to  hold  your  air  speed.”  (Grade  from  start  of  turn  to 
level  flight.) 

1.  Right  Steep  Turn. 


“Turn  to  a  heading  of  180°.  Now  do  a  steep  turn  to  tho  left  with  45° 
of  bank.  Roll  out  on  a  heading  of  0°.” 

2.  Lejt  Steep  Turn. 


E.  Pattern  B:  “Set  D/G  on  0°.  Now  do  a  pattern  B.  Shako  the 
stick  when  you  start.”  (Grado  each  leg  and  turn. separately. 
Wliero  change  of  air  speed  is  required,  continuo  grading  altitude 
and  heading,  but  allow  30  seconds  before  grading  air  speed.  If 
student  turns  in  wrong  direction  or  fails  to  complete  pattern, 
stop  grading,  and  X  out  remaining  measures.) 
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F.  Pattern  A:  "Cago  both  your  gyros.  Now  do  pattern  A.  Mako 
the  first  two  turns  to  tho  right  and  tho  next  two  turns  to  tho  left. 
Fly  ono  minute  legs.  Signal  when  you  start." 

rsc  Xr»; 
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G.  Unusual  Position  Recoveries:  “I  tun  going  to  give  you  unusual 
position  recoveries.  You  aro  to  take  over  mul  recover  to 
straight  and  level  (light  when  I  shake  the  stick.  (Give  the 
following  in  any  order.) 


Grade  by  Letter 


1.  Top  of  wing  over . .  a.  Smooth  and  safe. 

2.  Power-on  Ft  all .  1.  Hough  but  safe.  0.5 

3.  Power-ofT  stall .  c.  Dangerous,  hut  recovered  with¬ 

out  help. 

4.  Diving  spiral .  d.  Instructor  had  to  take  over. 


II.  Icing  Stall:  “I  will  reduce  power  and  simulate  an  icing  stall. 
Hold  your  altitude  and  heading  until  the  stall  and  then  make  a 
normal  recovery." 


1.  Highest  ait  speed  in  recovery 


I.  Power  Let-down:  “Uncage  the  D/G  onty  and  set  it  on  0®.  Estab¬ 
lish  a  power  let-down.  Hold  your  altitude  and  heading  until  you 
lower  the  gear.  Then  set  up  500  fect/.ninute  descent." 

1.  tl'Aife  establishing  let-down. 


J.  Descending  Tuiins:  “Now  do  a  ISO0  let-down  turn  to  the  right. 
Upon  completion  of  turn  do  a  ISO0  turn  to  the  left." 

_ 77 


1.  Rlzht. 


A/*> 


1 JVfc*. 

120  110  100 

UK'Dl-fi 

us 

1  1  1 

9$ 

1  «  »  1  1- 

2.  ho  ft.. 

A/6 


’ 

120  no 

too 

UN  CW 

IZS 

1  ,  I..L 

jj 

95 

AnCLC  Of  fiAnn 


_ 75 


_ rt 
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Taulb  AO.l. — Reliabilities  of  coded  item  scores  in  AT-8  instrument  scale 

Based  on  test  and  retest  administered  to  CO  students  on  successive  days  in 
different  planes  by  different  instructors 


Item 

fit 

M, 

Af, 

SDt 

SDt 

INSTRUMENT  TAKE-OFF: 

limiting  control  during  roll . 

a  IS 

3.01 

4.03 

a  09 

L  21 

a  oo 
.02 

A/S  control  inltlnl  climb . 

.11 

2.97 

1 88 

In.st  help  during  take-olT . 

*  —.03 

RIOII  T  CLIMUINO  TURN: 

Air  f|tecd control . . . 

.22 

3.13 

3.60 

3  87 

117 

142 

140 

L 10 
.93 

.07 

.63 

.72 

.79 

.74 

.72 

.01 

.04 

.60 

.68 

.84 

.97 

L10 

.89 

Angle  of  bnnk  control . 

.03 

STRAIGHT  CLIMB: 

Air  5 peed  control . 

1 .29 

Heading  control . 

i.3l 

1 17 

4.32 

LEFT  CUMBINO  TURN: 

Air  spied  control . 

1 , 35 

3.92 

1  40 

.78 

Angle  of  b  ink  control . 

.01 

4.03 

140 

.84 

STRAIGHT  CLIMB: 

Air  speed  control  . 

1.23 

123 

144 

.03 

Heading  control . 

.00 

4. 61 

149 

.03 

LEVEL  OUT: 

Altlludo  control . 

1.25 

3.91 

3. 91 

.03 

Heading  control . . . . . . . 

.19 

3.90 

112 

.02 

RIOIIT  STEEP  TURN: 

Altitude  control . 

.23 

3.33 

143 

1.08 

Air  S|iced  control . . . 

.00 

3.  71 

193 

.08 

Angle  of  bnnk  control..... . 

.00 

3.80 

143 

.04 

,79 

LEFT  STEEP  TURN: 

Altitude  control....... . . . . . 

I.2S 

3.73 

103 

.87 

.82 

Air  speed  control . 

.00 

3.60 

164 

.83 

~  93 

Angle  of  bAnk  control . . . . 

1.29 

193 

129 

l.Ot 

.80 

PATTERN  ••A" 

First  leg: 

Altitude . . . 

.21 

197 

i 

138 

.08 

.67 

Air  speed . 

-.03 

4.  is 

163 

.88 

.66 

Heading . . . . . . . . . 

.10 

3.  33 

3  91 

L  28 

L 17 

.82 

Second  leg: 

Altitude . 

.15 

173 

130 

1. 17 

Air  speed . . . ......... _ _ _ 

'.27 

193 

141 

LOS 

.05 

Third  leg: 

Altitude . . . . 

.22 

147 

12 

1.32 

.89 

Air  speed.. . . . . . 

i  .29 

107 

142 

1, 34 

.87 

Fourth  leg: 

Altitude . 

>.33 

144 

111 

1.30 

.91 

Air  speed _ _ _ ..... _ ... _ _ 

.20 

170 

133 

1.22 

.92 

First  turn: 

Altitude . . . . . . 

>.30 

148 

100 

1.12 

.89 

Air  speed _ _ _ ..... _ _ _ ... 

.02 

174 

121 

1.17 

.78 

Heading . 

-.07 

131 

149 

1.58 

L62 

Angle  of  bank................................... 

.01 

163 

118 

L  22 

.91 

Second  turn: 

Altitude......................................... 

>.34 

131 

102 

1.33 

.98 

Air  sliced . . . . . . 

.09 

178 

122 

L  20 

.74 

Heading . . . 

-.  19 

3.20 

161 

1.14 

L41 

Anglo  of  bank . . . 

-.02 

180 

123 

1.87 

.91 

Third  turn: 

Altitude................................ _ _ _ 

.19 

133 

113 

1.30 

.89 

Air  sliced . . . . . . . 

.09 

180 

132 

1. 10 

.78 

Heading . . 

.07 

1 11 

132 

1.62 

L49 

Angie  of  bank . . . 

.11 

172 

110 

1.20 

.89 

Fourth  turn: 

Altitude. . . . 

.09 

133 

114 

1.32 

.91 

Air  speed............. ................. ......... 

.22 

170 

123 

1.30 

.91 

1  lending . . . 

-.00 

102 

147 

1.67 

L43 

Anglo  of  bank............. . . . 

.07 

101 

117 

1.24 

.92 

PATTERN  "B" 

First  leg: 

Altitude......................................... 

>.31 

123 

172 

.78 

.49 

Air  speed . . . 

>.10 

131 

101 

.87 

.49 

Holding . .  .. 

-.03 

163 

175 

.70 

.47 

Second  lcg:w 

Altitude . . 

-.09 

103 

183 

.03 

.90 

Air  speed. . . . 

•-.32 

169 

1 10 

.02 

.89 

.20 

160 

138 

.68 

.70 

Third  leg: 

.03 

183 

1  IS 

l.Ot 

.92 

Air  sliced. . . . . . 

.03 

1 10 

103 

.02 

.96 

•.23 

123 

133 

1.01 

.89 

Fourth  leg: 

.13 

3.  SO 

177 

1.32 

1.09 

‘.27 

187 

191 

1. 21 

1. 12 

Heading . . . 

>.31 

189 

107 

1. 10 

LOS 

8oe  footnote*  st  end  of  table. 
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Table  A9.1. — Rchalthties  of  coded  item  tcores  in  AT-dt  i intlrument  irate — Con. 

Based  on  tests  and  retest  administered  to  GO  students  on  successive  days  In 
different  planes  by  different  instructors 


Item 

ra 

M, 

Ml 

SDt 

SDt 

PATTERN  “B"- Continued 

First  turn: 

Altitude . . . . 

0. 13 

3 

163 

3  01 
4.63 

3  39 

a  eo 

.99 
.  69 

1.10 

.90 

an 

•  U 

.  13 

3.  74 

II  ending . 

.05 

4.M 

3.  19 

3.  M 

Second  turn: 

Altitude  . . . . 

l.  31 

.04 

Air  speed.. . . 

1.20 

3.  7S 

.87 

Heading . . . 

.os 

i.  46 

4.  23 

.73 

1.00 

1. 11 

L3 

Third  turn: 

Altitude . 

.07 

132 

3.49 

1.19 

1.14 

1.14 

1.04 

Air  speed . . . . 

.01 

1M 

X  V2 

Heading . 

.  16 

i  m 

4.26 

1.37 

1.07 

Fourth  lain: 

Altitude  .. . .  .  ... 

.19 

3.  *7 

3.  M 

.21 

1' 

1V»3  i 

1.  It 

1.03 

Jletvflng..  . . .  . .  .  . . . 

.  10 

127 

136 

1. 16 

i.io 

UNI'S  UAL  POSITION  RECOVERIES: 

AVIng  over . . 

.23 

1 14 

3.31 

.03 

.72 

Powcr-on  stall . . 

— .  06 

3.  20 

3.42 

Kf 

.  70 

Fowcr-ofT  stall . . . 

-.22 

3.37 

X  x\ 

Hi 

.60 

Diving  spiral . . 

13 

2.M 

XOi 

Kl 

.72 

ICINO  STALL: 

Altitude.  .  _  ....  .  .  ... 

■  OS 

2.  70 

3.  17 

1  30 

1.  29 

lit  n  ling . . 

AnrlpofhrinV  . .  _ _ _ 

>..k. 

.to 

.00 

2.K7 

3. 16 

3.31 

123 

1.  40 
1.21 

1.44 

1.23 

POWKIt  LKT-DOWN: 

Altitude 

— .  14 

mm 

4.  II 

1  24 

.M 

Angle  of  bank .  . . .  . . . 

.0) 

3.33 

ltd 

1.19 

L04 

HIOHT  UKSCKNDINQ  TURN: 

Air  ypcod . . . . . 

.  II 

134 

4  06 

1. 19 

.1 

.03 

3.33 

3.  S3 

1. 19 

LM 

LKFT  UKSCKNDINO  TURN: 

*.34 

3.61 

103 

1. 13 

1  *3 

.13 

147 

174 

1.04 

i.a 

•  3  or  less  dinners  In  100  of  obtaining  n  positive  cornlutloii  of  this  sire  by  dinner  nlone. 

•  1  or  loss  dinners  in  100  of  obtaining  a  positive  correlntion  of  this  sl;c  by  cltanct-  aloM. 

•  Tetrachoric  r. 

Table  A9.2. — Validities  of  coded  item  scores  in  AT-6  instrument  seals 
Based  on  scores  for  second  day 


Item 

m 

wm 

At. 

Aft 

SO, 

.**•» 

INSTRUMENT  TAKE-OFF: 

01 

0. 332 

4.14 

: 

3.73 

1.94 

» 0.  24 

91 

.  314 

.1,  Ml 

3.  II 

1.13 

.'20 

instructor  help  during  take-off . 

91 

.321 

167 

2.20 

.90 

* .  33 

PIQlir  CLIMIUNU  TURN: 

97 

.330 

3. 90 

3. 62 

.14 

.97 

97 

.  33(1 

4.12 

4.09 

1.14 

.00 

BT R  A  It  11  IT  CLIMB: 

.  .330 

4.79 

4.00 

.90 

.19 

97 

00 

.Ml 

4. 37 

4.33 

.72 

.01 

LEFT  CLIMBING  TURN: 

90 

.  331 

4.29 

4.20 

.72 

.Oft 

97 

.310 

4.27 

4.27 

.79 

.00 

STRAIGHT  CLIMB: 

04 

.  332 

4.40 

4.32 

.61 

.1* 

04 

.312 

4. 34 

4.20 

•  W  I 

'  .20 

LEVEL  OUT: 

97 

.f.M 

4.14 

3.  TO 

.so 

*.34 

97 

.3.0 

4  33 

3.74 

.V3 

*  .41 

RIGHT  STEEP  TURN: 

94 

.331 

132 

2.90 

l.» 

>.29 

97 

.  320 

3.94 

3.70 

.19 

97 

.320 

4.43 

1.30 

.  M 

.1/9 

LEE  r  S  TEEP  TURN: 

94 

.331 

3.03 

ISO 

.*3 

.04 

90 

.M2 

;i.  *.7 

i.  '5 

.95 

.w 

97 

.130 

4.19 

4. 77 

.VI 

—.05 

PATTERN  "A" 

First  let: 

Oft 

.331 

4.31 

4.04 

.*>0 

.«• 

93 

.  3  20 

4.  34 

1  ^1 

1 .24 

1  .11 

93 

.320 

3.74 

.3.11 

Table  A9.2. — Validities  of  coded  item  scores  in  AT-6  instrument  scale — Continued 


Based  on  scores  for  second  day 


Item 

N, 

fll 

M. 

A/i 

SD, 

r»<» 

PATTERN  "A"— Continued 
tlecomt  ley: 

Altitude 

08 

0.331 

4.38 

3. 87 

0.80 

*  0  30 

Airspeed  ...  . 

00 

.331 

4.37 

ZOO 

.80 

*.33 

Third  Ick: 

Altitude  . . 

08 

,  331 

4.00 

3.80 

.00 

.07 

Air  sj>ccd  . 

08 

.331 

4.42 

4.04 

.88 

1 .27 

Fourth  let;: 

Altitude . . 

07 

.530 

4.21 

3.87 

1.06 

.21 

Air  <pccd . 

04 

.321 

4.37 

Z  93 

1.02 

1. 27 

First  turn: 

Altitude  . 

08 

.331 

3.00 

3.60 

1.08 

» .27 

Air  speed  . .  . . 

00 

.331 

4.12 

4.04 

.87 

.03 

Head' Iny  ,  . 

08 

.331 

3.  40 

Z30 

1.63 

.00 

Ancle  of  hank . 

00 

.831 

4.12 

4.04 

.01 

.03 

Second  turn: 

Altitude  . 

00 

.331 

4.12 

Z40 

1.02 

•.39 

Air  snood 

07 

.520 

4.27 

4.00 

.79 

.22 

Heading  . 

94 

.343 

3.09 

3.28 

1.30 

.10 

Angle  of  bank . 

00 

.331 

4.08 

4.24 

.91 

-.12 

Third  turn: 

Altitude . . 

07 

.530 

4.21 

3.80 

1.00 

■  .20 

Air  speed . 

07 

.330 

4.35 

3.80 

.03 

•.30 

Heading  ..  . . . . 

03 

.527 

3.43 

Z34 

1.61 

.04 

Anglo  of  bank . 

00 

.321 

4.30 

Z80 

.00 

•.20 

Fourth  turn: 

Altitude  . 

07 

.M0 

4.12 

Z82 

1.00 

.18 

Air  sneed . 

07 

.338 

4.33 

Z03 

.01 

'.27 

Heading . 

07 

.MO 

3.38 

ZOO 

1.64 

.12 

Angle  of  bank . 

00 

.Ml 

4.20 

Z01 

.00 

.18 

PATTERN  "B" 

First  lei: 

Altitude . 

08 

.Ml 

4.73 

141 

.07 

1.30 

Air  speed . . . . 

07 

.520 

4.63 

4.33 

.00 

.10 

Heading . 

07 

.520 

4.78 

130 

.70 

>.33 

8econd  leg:- 

Altitude . 

08 

.331 

3.02 

Z  76 

.80 

.12 

Air  sj\  rd . . . . . 

OS 

.647 

3.08 

Z01 

1.00 

.04 

Heading  . 

03 

.637 

4.41 

110 

.84 

.19 

Third  leg: 

Altitude . 

08 

.631 

4.36 

3.80 

.02 

•.37 

Air  speed . 

07 

.620 

4.24 

ZOI 

.00 

.22 

Heading . . 

00 

.621 

4.  30 

4.00- 

1.03 

.17 

Fourth  leg: 

Altitude . . . . 

00 

.621 

3. 74 

Z60 

LIZ 

.13 

02 

.611 

4. 16 

Z  64 

1. 14 

'.29 

Heading  . . 

00 

.621 

4. 12 

3.87 

1. 21 

.13 

First  turn: 

Altitude . . . . . 

08 

.631 

3.07 

Z50 

.82 

.13 

DO 

.642 

4.04 

Z  70 

.80 

.24 

Heading.,.. . . . . . 

OS 

.637 

4.67 

4. 10 

I.OS 

.24 

Second  turn: 

Altitude... . . . 

08 

.Ml 

3.62 

Z  16 

1.07 

'.27 

Air  speed . . . . . 

07 

.620 

3. 04 

3. 57 

.07 

.34 

'lending . . 

03 

.610 

4.41 

100 

1.22 

.18 

Third  turn: 

Altitude . . . .... 

08 

.631 

3.71 

Z  17 

1.21 

'.28 

Air  speed... . . . 

07 

.620 

4.04 

Z  69 

1. 15 

'.23 

Heading... . . . . 

00 

.621 

4.26 

113 

1.26 

.07 

Fourth  turn: 

Altitude . . . . 

07 

.620 

3.08 

Z64 

1. 14 

.24 

00 

.Ml 

4.  12 

Z  80 

1.13 

1.31 

Heading . 

00 

:  .622 

4.47 

Z08 

1.26 

‘.23 

UNUSUAL  POSITION  RECOVERIES: 

03 

.637 

3. 18 

Z  30 

.73 

-.18 

Power-on  stall . 

04 

.643 

3.31 

3.60 

.04 

-.34 

02 

.543 

3.32 

Z  38 

.03 

.00 

03 

.637 

ZOO 

ZOI 

.78 

.04 

IC1NO  STALL: 

Altitude  - . 

03 

.620 

zoo 

3.20 

1.30 

-.13 

04 

.632 

Z  14 

ZOO 

1.30 

.02 

87 

.640 

1.11 

Z03 

1.33 

.03 

row  Kit  LET  DOWN: 

Altitude  . 

03 

.620 

3.00 

3.06 

.00 

.01 

97 

.320 

ZOO 

Z  61 

1.01 

.18 

RK1HT  DESCENDING  TURN: 

07 

.320 

4. 14 

Z  73 

.03 

'.28 

07 

.520 

ZOO 

Ztt 

.03 

'.  20 

LEFT  DESCENDING  TURN: 

00 

.621 

4. 10 

Z  72 

1.03 

'.27 

Ancle  of  hank  . . 

00 

.621 

ZOO 

Z62 

1.00 

.22 

i  j  or  loss  chances  In  100  of  obinlnlng  a  positive  correlation  of  this  slie  by  chance  stone. 
•  1  or  less  chances  In  100  of  obtaining  a  positive  correlation  of  this  site  by  chance  alone- 
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APPENDIX  TO  CHAPTER  TEN _ 

Copies  of  the  Check  Ride  Book¬ 
lets  for  Objective  Measures  of 
Flying  Skill  During  Tempo¬ 
rary  Training  Freezes 


PRIM  All  Y 


Name:  (Last)  (First)  <M(i|«llc)  (Avn.  A3.V) 

C.  Date: .  Class . 

Day  Mouth  Yc»r 

School .  Don’t  write  here:  Secretary 

Place .  "ill  supply  pilot  stnnino 

(with  credit  added). 

P+Cr: . 

D.  Did  you  have  any  flying  experience,  handling  the  controls  of  ft 

plane  in  the  air,  before  entering  primary  flying  schoolt  (Circlo 
the  number  following  the  answer  that  applies  to  you.) 

Soloed  l)cforc  entering  primary  school .  1 

More  than  4  hours  stick  time  but  never  soloed .  2 

Less  than  4  hours  of  stick  time . 3 

E.  Circle  the  appropriate  number  to  indicate  the  kind  of  piano  or 

planes  on  which  you  had  the  10  weeks  of  primary  training 
bejore  t'  freeze. 

Fairchild  followed  by  Stearman .  1 

Only  Stearman .  ^ 

Only  Fairchild . - .  ® 

Other .  * 

F.  Circle  tho  appropriate  number  to  indicate  the  number  of  classes 

vou  have  been  held  over  after  graduating  from  preflight. 


None . 

Once . 

Twice . . 

Three  or  more. 


G.  Reject: 


Yes . 

Check  Pilot: 


703322—47 - 30 


4*15 


H.  Number  of  Hours  Student  Has  Had  on  Stearman  Plane. 

Circle  proper  number  below: 


0-10  hours . . . . . _  i 

11-20  hour* . . . . . . 1  2 

21-30  hours.. _ _ 3 

31-40  hours... _ _ 4 

41-50  hours _  5 

51-G0  hours... . 6 

61-70  hours... . 7 

71-80  hours _  8 

81  or  moro  hours.. . 9 


Irmnclmann 

I.  Check  pilot  lines  plane  up  with  road.  Ho  says,  “Do  an  Immcl- 
mann.  Start  with,  an  air  speed  no  greater  than  150  m.  p.  h.  Use 
throttlo  any  way  you  want  to.  You  will  get  a  good  score  if 
your  starting  speed  is  not  abovo  150  m.  p.  h.  and  if  you  come 
out  lined  up  within  45  degrees  of  the  road  without  stalling." 

Circle  proper  number  below: 


COMES  OUT  WITHIN  ±45®  OF  ROAD  WITHOUT  STALLING .  3 

COMES  OUT  HEYOND  ±45®  OF  ROAD  WITHOUT  STALLING .  2 

STALLS  (On  STARTS  FASTER  THAN  150  M.  P.  H.) . .  1 


Loop 

J.  Check  pilot  lines  piano  up  with  road.  IIo  says,  “Do  a  loop. 
Start  with  an  air  speed  no  greater  than  110  m.  p.  h.  Uso  throttle 
any  way  you  want  to.  You  will  get  a  good  scoro  if  your 
starting  speed  is  not  above  1 10  in.  p.  h.  and  if  you  como  out  lined 
up  within  45  degrees  of  tho  road  without  stalling." 


COMES  OUT  WITniN  ±45®  OF  ROAD  WITHOUT  STAI.LINO  . .  3 

COMES  OCT  HEYOND  ±45®  OF  nOAD  WITHOUT  STALL1NO . . .  2 

STALLS  (OR  STARTS  FASTER  THAN  IIO  M.  P.  H.) . .  1 


Two  360°  Turns  (Left  and  Right) 

Check  pilot  lines  piano  up  with  road  or  section  lino  at  safe  altitude. 
Ho  says,  “Do  a  300°  turn  to  tho  left  with  a  bank  of  at  least  60°. 
When  tho  bank  is  60°,  tho  cabano  strut  will  bo  parallel  with  the 
horizon.  Immediately  after  tho  300°  turn  to  tho  left,  do  a  360°  turn 
to  tho  right  with  a  bank  of  at  least  60°.  You  will  got  a  good  scoro  if 
your  altitudo  varies  no  moro  than  20  feet  abovo  or  below  your  starting 
altitude,  if  your  bank  stayB  abovo  G0°  after  you  roll  into  a  turn,  and 
if  you  roll  out  of  tho  second  turn  lined  up  within  45°  of  your 
starting  heading." 
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Scoring  Directions: 

K.  Note  tho  starting  altitude  K. 

and  record  tho  maximum 
deviation,  either  above  or 
below,  from  this  starting 
altitude. 

L.  Record  if  student  falls  be-  L. 

low  GO0  bank  between  roll- 
in  and  roll-out  on  each 
turn. 

M.  Record  if  student  rolls  out  M. 

of  second  turn  within  45® 
of  heading  at  beginning  of 
first  turn. 


Circle  proper  number  below: 
Altitude  Deviation: 


0  to  ±20  ft .  3 

±21  to  ±  GO  ft .  3 

±G1  ft.  anil  over . .  1 


Maintained  GO®  bank  or 


more: 

In  each  turn . . 3 

In  one  turn  only . .  3 

In  neither  turn . 1 

Final  roll-out: 

Within  45* .  3 

Outside  45*. .  I 


Simulated  Forced  Landing 

Check  pilot  chooses  a  field  about  three-quarters  of  a  mile  squnro, 
disregarding  suitability  of  terrain  for  actual  landing.  Ho  says,  "Sco 
that  field?  (Describes  field  and  makes  suro  student  identifies  it.) 
When  wo  aro  directly  over  that  field  flying  downwind  at  1,200  Jeet 
above  the  ground ,  I’ll  cut  tho  throttle.  You  will  simulato  a  forced 
landing  in  tho  first  two-thirds  of  that  field.  You  will  get  a  good  scoro 
if  you  make  a  base  leg  which  would  get  into  the  first  two-thirds  of  tho 
field  without  slipping.” 


N. 

O. 


Circle  proper  number  below: 

Student  Simulates  a  Base  N-  Yes . 

Leo:  No . 

Student  Would  Have  0.  In  firvt  2/3 . 

Landed:  Outsido  first  2/3 . 


3 

1 

3 

I 


Two  Accuracy  Landings 

Cheek  pilot  puts  plane  on  45°  entry  to  rectangular  pnttern.  IIo 
says,  “Make  a  three-point  landing  in  tho  middlo  zono  marked  oil  by 
tho  lines  (flags).  Ajter  cutting  the  throttle  at  the  keg  position,  do  not  use 
any  throttle  unless  you  are  going  to  miss  the  field  entirely.  Don’t  make  a 
wheel  landing.  Mako  a  three-point  landing.  You  will  bo  graded 
on  whero  you  land.  A  landing  with  tnil  ns  high  as  horizontal  or  a 
bounce  of  more  than  3  feet  will  givo  you  tho  lowest  scoro.  After  you 
finish  tho  first  landing,  take  oir  and  do  another  one  just  tho  samo. 

“You  will  get  only  one  try  at  each  Ian-  mg.  If  you  miss  tho  field 
and  havo  to  go  around  for  safety  reasons,  i  hnt  counts  ns  one  landing.”® 

•u  bad  landing  necessitates  go- around,  circle  tba  No.  1  for  P,  Q,  and  R  or  for  8,  T,  and  U,  as  lb# 

case  may  bo. 
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Scoring  Directions: 

P  and  S.  Record  in  which  zone 
tho  wheels  of  the  plane  first 
touched  the  ground.  (Plane 
must  land;  no  second  try  or  go- 
around  allowed.) 

Q  and  T.  Record  if  tail  in  hori¬ 
zontal  position  or  higher  on 
landing. 


R  and  U.  Record  if  plane  bounced 
3  foot  or  more. 


Circle  proper  number  below: 

P.  Area  where  plane  first  touches: 

1 

2 
3 
2 
l 


Q.  Landing  Position: 

3-point  or  slightly  tail  first..  3 
Wheels  first — tail  below  hori- 

zontal .  2 

T&il  horizontal  or  higher _  l 


R.  Bounced  or  Dropped  in: 


Neither . 3 

Less  than  3  feet _ _  2 

More  than  3  feet .  1 


S.  Area  whero  plane  first  touches: 

1 

2 

_3 

~  2 
I 


T.  Landing  Position: 

3-point  or  slightly  tail  first. .  3 

Wheels  first — tail  below  hori¬ 
zontal .  2 

Tail  horizontal  or  higher _  1 

U.  Bounced  or  Dropped  in: 

Neither .  3 

Less  than  3  feet . .  2 

More  than  3  feet _ _ _  1 


BASIC 


Name:  (Las!)  (First)  (MicMlc) 

C.  Dato: . 

Dijr  Month  Ymr 

School . 

Placo  . 


B . 

(Am  Csdet  ASN) 

Class . . . 

Don’t  write  here:  Secretary  will 
supply  pilot  stnnino  (with  credit 
added) 

P  +  Cr: . 


D.  Did  you  have  any  flying  experience,  handling  the  controls  of  a 
plane  in  the  air,  before  entering  primary  flying  school t  ( Circle 
the  number  following  the  answer  that  applies  to  you.) 
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Polood  before  entering  primary  school . .  1 

More  than  4  hours  stick  time  but  never  soloed _ _ _ ..  2 

Less  than  4  hours  of  stick  time .  3 


E.  Circle  the  number  indicating 

tho  kind  of  plane  or  planes 
on  which  you  had  your 
primary  training. 

F.  Circle  the  number  to  indicate 

what  plane  or  planes  you 
used  during  tho  10  weeks  of 
basic  training  before  the  freeze. 


Fairchild,  then  Stcnrnmn . .  1 

Ityan,  then  Stearinan .  2 

Only  Stcarnmn . 3 

Only  Fairchild . 4 

Only  Ityan . 5 

BT  (13,  14,  13)  and  8  or  +  hra. 

AT-0 .  I 

BT  (13,  14,  13)  and  8  or  +hn». 

AT- 1 7  or  UC-78 .  2 

BT  (13,  14,  13)  and  8  or  +hra. 

AT- 10 .  3 

•Only  BT  13,  14,  or  15 . 4 

•Only  AT-0 .  5 

•Only  AT- 1 7  or  UC-78 .  8 

♦Only  AT- 10 .  7 

Other . 8 

If  other,  specify.  . . . . . 


•L*u  than  S  hr».  on  other  plan*. 


G.  Circlo  the  appropriate  number  N°n« . 

to  indicate  tho  number  of  . 

classes  you  have  been  held  Three  or 'more 
over  in  all  phases  of  training 
after  graduating  from  pre- 
flight. 

H.  Reject:  n’° . 


0 

1 

2 
3 


1 

2 


Check  Pilot:  Contact . . Instrument 


Two  180°  Steep  Turns  (Left  and  Right) 

Directions  to  Student:  “You  arc  lined  tip  with  a  road  (or  section 
line).  I  want  you  to  do  a  180°  steep  turn  to  me  left  and  immediately 
roll  from  that  into  a  180°  steep  turn  to  the  right.  You  must  reach 
a  bank  of  at  least  G0°  in  each  turn,  ^ou  will  lie  graded  on  your 
greatest  deviation  from  tho  starting  altitude  and  on  whether  or  not 
you  reach  a  G0°  bank  in  each  turn.” 

Scoring  Directions:  Circle  proper  number  bolow: 


I.  Note  tho  starting  altitude  an«l  I.  Maximum  deviation  in  foot 
record  tho  maximum  devia-  from  stalling  altitudo. 


tion,  either  nbovo  or  below, 
from  this  starting  altitudo. 


0  to  ±50  feet .  3 

±  51  to  ±  100  fret .  2 

±  101  feet  and  over .  i 


J,  Record  whether  or  not  student  J.  Reached  GO0  bank: 


reaches  a  G0°  bank  at  least 
onco  in  each  180°  turn. 


In  each  turn.... 
In  one  turn  only 
In  neither  turn.. 
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3 

2 

1 


Accuracy  Landing  (Throttle  and  Flaps  As  Desired) 

Directions  to  Student:  "I'll  put  the  piano  on  45°  entry  to  rec¬ 
tangular  pattern.  I  want  you  to  make  a  three-point  landing  in  the 
middle  zono  marked  off  by  tho  lines  (flags).  Use  throttle  and  flaps 
as  you  desire. 

“Don't  mako  a  wheel  landing.  Make  a  three-point  landing.  You 
will  bo  graded  on  where  you  land.  A  landing  with  tail  as  high  as 
tho  horizontal  position  or  bounce  of  more  than  3  feet  will  give  the 
lowest  score.  Do  not  go  around  unless  you  havo  to  for  safety 
reasons."* 

Scoring  Directions: 

K.  Record  in  which  zono  tho  K.  Area  whore  plane  first 
wheels  of  tho  piano  first  touches, 
touched  tho  ground.  1 

2 
3 
2 
I 

L.  Landing  Position: 

Three-point  or  slightly  tail 

first....... . 3 

Wheels  first — tail  below 

horizontal . . 2 

Tail  horizontal  or  higher..  1 

M.  Bounced  or  Dropped  In: 

Neither . .  3 

Less  than  3  feet .  2 

More  than  3  feet .  1 

•If  bad  landing  necessitates  go-wound,  circle  the  No.  1  tor  X,  L,  and  M. 

Accuracy  Landings  (Flaps  As  Desired) 

Directions  to  Student:  “Continuo  in  traffic  pattern.  Make  a. 
threo-point  landing  in  tho  middlo  zono  marked  off  by  tho  lines  (flags). 
After  cutting  the  throttle  at  the  key  position,  do  not  use  any  throttle 
unless  you  are  going  to  miss  the  field  entirely.  Use  flaps  as  desired. 

“Don't  mako  a  wheel  landing.  Mako  n  three-point  landing.  You 
will  bo  graded  on  where  you  land.  A  landing  with  tail  ns  high  os  tho 
horizontal  position  or  a  bounco  of  moro  than  3  foot  will  givo  you  the 
lowest  scoro.  Do  not  go  around  unless  you  havo  to  for  safety  reasons".* 

*  If  bad  landtag  necessitates  go-wound,  circle  the  No.  1  for  N,  O,  and  P. 


L.  Record  attitude  on  landing. 


M.  Record  whether  piano  bounced 
or  dropped  in. 
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Scoring  Directions: 

N.  Record  in  which  zono  the 
wheels  of  tho  piano  first 
touched  tho  ground. 


O.  Record  if  tail  in  horizontal 
position  or  higher  on  landing. 


Circle  proper  number  below: 
N.  Area  whero  piano  first 
touches. 


O.  Landing  Position: 

Throe-point  or  slightly  tail 

first.... . 3 

Wheels  first — tail  below 

horizontal . 2 

Toil  horizontal  or  higher..  1 


P.  Record  if  piano  bounced  3  feet  P.  Bounced  or  Dropped  In: 


or  more.  Neither .  3 

Less  than  3  feet . .  2 

More  than  3  feet . .  1 


Straight  And  Level  Flight  (Instrument) 

Directions  to  Student:  “Signal  when  you  are  flying  level  at  90° 

(or  270°)  heading  at  120  m.  p.  h.  at - feet  nltitudo.  (Select  altitudo 

for  smoothest  air  possible.)  (Wait  for  signal.)  Cago  tho  directional 
gyro  and  artificial  horizon.  Indicato  when  this  has  been  done. 
(Wait  for  caging  of  instruments.)  Now  fly  straight  and  lovel  at  120 
m.  p.  h.  for  3  minutes.  You  will  be  graded  on  variations  in  heading, 
air  speed,  and  altitude." 


Scoring  Directions: 


Q.  Noto  starting  heading  and  Q.  IIeadino  Deviation: 

record  maximum  deviation,  o*to±5* . 

plus  or  minus.  ±0°  to  ±10* . 

±  II*  and  over . 


R. 


S. 


and  R.  Air  Speed  Deviation 


Noto  starting  aii  speed 
record  maximum  deviations, 
plus  or  minus. 

Noto  starting  altitudo  and 
record  maximum  deviation, 
plus  or  minus. 


0  to  ±5  in.  p.  h . 

±5  to  ±10  m.  p.  h... 
±11  m.  p.  h.  and  over 

S.  Altitude  Deviation: 

0  to  ±50  feet . 

±51  to  ±  100  feet.... 
±  101  feet  ami  over... 


w  M  U  »  W  U  *<  U  « 


360°  Steep  Right  Turn  (Instrument) 

Di  ructions  To  Studknt:  “Mako  a  360°  right  turn  with  a  bank  of 
over  30°  at  an  uir  speed  of  120  m.  p.  h.  and  come  out  on  a  heading. 
Use  full  instrument  panel.  You  will  be  graded  on  variations  in  altitude 
during  turn  and  deviation  from  correct  heading  at  end  of  turn.  If 
your  bank  falls  to  SO0  or  below  during  turn,  you  will  receive  the  lowest 
score'* 

Scoring  Directions:  Circle  proper  number  below: 


T.  Noto  heading  at  beginning  T.  Headino  Deviation: 

•  and  end  of  turn.  Record  0°  to  ±5# . 3 

difference,  plus  or  minus.  ±6°  to  ±10° . 3 

±11°  and  over .  1 

U.  Noto  starting  altitude  and  U.  Altitude  Deviation: 

record  maximum  deviation,  0  to  ±50  feet . 3 

plus  or  minus.  ±51  to  ±100  feet . 3 

±  101  feet  and  over _  1 

V.  Noto  bank  on  artificial  hori-  V.  Over  30°  Bank: 

zon  and  record  if  bank  falls  Maintained . 3 

to  30°  or  below  at  any  time  NOT  maintained .  1 

during  turn  except  on  roll- 
in  nnd  roll-out. 


Constant  Speed  Climb  and  Descent  (Instrument) 

Direciions  To  Student:  “Fly  straight  and  level  at  a  90°  or 
(270°)  heading  at  110  m.  p.  h.,  repeat  110  m.  p.  h.  (Wait)  Now  climb 
1,000  feet  at  500  feet  per  minuto  and  immediately  start  descent. 
Level  off  at  starting  altitude,  holding  110  m.  p.  h.  During  this  rtuv- 
ntuver  hold  the  heading  and  air  speed  constant.  You  will  bo  graded  on 
variations  in  heading  nnd  air  speed  during  maneuver  and  on  deviations 
from  correct  altitude  at  top  and  bottom.” 


Scoring  Directions: 

W.  Noto  starting  heading  and  W. 
record  maximum  deviation, 
plus  or  minus. 


X. 


Y. 


Noto  starting  air  speed  nnd  X. 
record  maximum  deviation, 
plus  or  minus. 


Noto  deviations  from  the  cor¬ 
rect  altitudes  at  top  of 
climb  nnd  at  end  of  descent 
nnd  check  tho  deviation 
that  was  greatest. 


Y. 


Heading  Deviation: 

0°  to  ±5° . 3 

±0°  to  ±10° . 3 

±  1 1°  and  over . I 

Am  speed  Deviation: 

0  to  ±5  m.p.h _ 3 

±8  to  ±10  m.p.h . -  3 

±11  m.p.h.  and  over . .  1 

Altitude  Deviation: 

0  to  ±50  feet . 3 

±51  to  ±100  feet . 3 

±  101  feet  and  over . .  1 
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ADVANCED  SINGLE  ENGINE 


A .  B . 

Name:  (Last)  (First)  (Middle)  (Avn.  C.vht  ASM) 

C.  Date: .  Class . 

'  Doy  Month  Year 

School . . .  Don’t  write  here:  Secretary  will 

supply  pilot  stanino  (with  credit 
added). 

Place .  P-f  Cr: . 


D.  Did  you  have  any  flying  experience,  handling  the  controls  of  a 
piano  in  the  air,  before  entering  primary  flying  school  t  ( Circle 
the  number  following  the  answer  that  applies  to  you). 


Soloed  before  entering  primary  school . . _  . . .  1 

More  than  4  hours’  stick  time  but  never  soloed . . . .  2 

Less  than  1  hours  of  stick  time . . . : . .  3 


Circle  the  number  indicating  the  kind  of  plane  or  planes  on  which 
you  had  your  primary  and  basic  training. 

E.  At  Primary:  F.  At  Basic: 

Fairchild  and  Stoarman...  I  DT  (13,  14,  15)  and  8  or 

Ryan  and  Stcarmnn _ _  2  +  hours  AT-fl .  I 

Only  Stearman .  3  BT  (13,  14,  15)  and  8  or 

Only  Fairchild.. .  4  +  hours  AT-17  or  UC- 

Only  Ryan .  5  78 .  2 

Other .  8  BT  (13,  14,  15)  and  8  or 

+  hours  AT- 10 . .  3 

•Only  BT  13,  14,  or  15..  4 

•Only  AT-0 .  5 

•Only  AT-17  or  l'C-78..  5 

•Only  AT-10 .  7 

•Other .  8 

•U  m  than  8  hour*  on  oth«  plan**. 


G.  Circlo  the  number  to  indicato 
what  plane  you  used  during 
tho  10  weeks  of  AD¬ 
VANCED  training  before  the 
freeze. 

II.  Circlo  tho  appropriate  number 
to  indicato  tho  number  of 
classes  you  have  been  held 
over  in  all  phases  of  training 
after  graduating  from  pre¬ 
flight. 

I.  Reject: 


AT-8 .  1 

AT-9 .  2 

AT-10 .  3 

AT  17  or  l’C-78 .  4 

B-2f .  5 

Other _  0 

None . .  0 

Once . . . . . ...  1 

Twico .  3 

Three  or  more . . 3 


No .  1 

Yes .  3 


Check  Pilot:  Contact 


Instrument 
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Two  Maximum  Performance  Loops 

Directions  to  Student:  “Do  two  separate  maximum  performance 
loops  with  a  starting  A/S  no  greater  than  160  m.  p.  A.,  tachometer 
reading  of  1,026  r.  p.  m.t  and  manifold  pressure  of  25' '  Hg.  Do  each 
loop  without  using  more  throttle.  After  finishing  the  first  loop,  clear 
yourself  and  then  do  the  second.  Do  each  loop  without  stalling  out  or 
letting  the  piano  shudder." 


Scoring  Directions:  For  each  Circle  proper  numbor  below: 

*00P:  J.  First  Loop: 

Circle  3.— If  the  piano  does  not  No  stall  or  shudder .  3 

shudder  even  slightly  or  stall  or  Shudder .  2 

fall  out.  Stalled,  fell  out,  used  throt- 

Circle  2.— If  tho  piano  shudders  tie, orover ICOm.p.h...  1 

oven  slightly  but  docs  not  stall  K.  Second  Loop: 

or  fall  out.  No  stall  or  shudder . .  3 

Circle  1. — If  starting  A/S  is  more  Shudder .  2 


than  160  m.  p.  h.,  if  throttle  is  Stft,,cd*  fcH  out-  UNid  throt- 

used  in  loop,  or  if  piano  stalls  * 

or  falls  out. 

Two  180°  Steep  Turns  (Left  and  Right) 

Directions  to  Student:  “You  are  lined  up  with  a  road  (or  section 
lino).  I  want  you  to  do  a  180°  steep  turn  to  the  left  and  immediately 
roll  from  that  into  a  180°  steep  turn  to  tho  right.  You  must  reach  a 
bank  of  at  least  60°  in  each  tum.  You  will  bo  graded  on  your  greatest 
deviation  from  tho  starting  altitude  on  whether  or  not  you  reach  a  60° 
bank  in  each  turn." 

Scoring  Directions:  ^  Circle  proper  number  below: 

L.  Noto  tho  starting  altitudo  and  L.  Maximum  deviation  in  feet 


record  tho  maximum  devia-  from  stai  ting  altitude: 

tion,  cither  above  or  below,  0  to  ±50  feet .  3 

from  this  starting  altitudo.  ±  51  to  ±  100  feet . 1  2 

±101  feet  and  over.....  1 

M.  Record  whether  or  not  student  M.  Reached  60°  bonk: 

reaches  a  60°  bank  at  least  In  each  turn . .  3 

onco  in  each  180°  tum.  In  one  turn  only .  2 

In  neither  turn .  1 


Accuracy  Landing  (Throttle  and  Flaps  as  Desired) 

Directions  to  Student:  “I’ll  put  tho  plane  on  45°  entry  to 
rectangular  pattern.  I  want  you  to  mako  a  3-point  landing  in  the 
middlo  zone  marked  off  by  tho  lines  (flags).  Use  throttle  and  flaps  as 
you  desire. 


454 


“Don't  make  a  wheel  landing.  Mako  a  3-point  landing.  You  will 
bo  graded  on  where  you  land.  A  landing  with  tail  as  high  as  the  hori¬ 
zontal  position  or  bounce  of  moro  than  3  feet  will  give  the  lowest  scoro. 
Do  not  go  around  unless  you  havo  to  for  safety  reasons."* 

Scoring  Directions:  Circle  proper  number  below: 

N.  Record  in  which  zone  the  N.  Area  whero  piano  fir»t  l 


I 

O.  Record  attitudo  on  landing.  0.  Landing  Position: 

3-pt.  or  slightly  toil  first.  3 

Wheels  first — tAil  below 

horizontal . 2 

Tail  horizontal  or  higher.  1 

P.  Record  whothor  plane  P.  Bounced  or  Dropped  In: 

bounced  or  dropped  in. 

Neither _ 3 

Less  than  3  feet _ 2 

Moro  than  3  feet .  I 

Straight  and  Level  Flight  (Instrument) 

Directions  to  Student:  “Signal  when  you  nro  flying  level  at  90° 

(or  270°)  heading  at  130  m.  p.  h.  at - feet  altitude.  (Select  altitudo 

for  smoothest  air  possible.)  (Wait  for  signal.)  Cago  tho  directional 
gyro  and  artificial  horizon.  Indicate  when  this  has  been  dono.  (Wait 
for  caging  of  instruments.)  Now  fly  straight  and  level  at  130  m. 
p.  h.  for  3  minutes.  You  will  bo  graded  on  variations  in  heading, 
air  speed,  and  altitude.” 


wheels  of  tho  piano  first 
touched  tho  ground. 


touches. 


2_ 

3_ 

2 


Scoring  Directions: 

Q.  Noto  starting  heading  and  Q. 
record  maximum  deviation, 
plus  or  minus. 


Heading  Deviation: 

0®  to  ±5® . 

±0®  to  ±10® . 

±11®  and  over . 


3 

2 

1 


R. 


S. 


Noto  starting  air  speed  ond  R. 
record  maximum  deviation, 
plus  or  minus. 

Noto  starting  altitudo  and  S. 
record  maximum  deviation, 
plus  or  minus. 


Air  speed  Deviation: 

0  to  ±5  m.  p.  h . 

±0  to  ±10  in.  p.  h . . 

±11  ni.  p.  h.,  and  over..-- 

Altitude  Deviation: 

0  to  ±60  feet . - 

±51  to  ±100  feet . 

±  101  feet  and  over - - 


*](  bad  landing  nec*sjlut«  10  around,  clrcU  th*  No.  I  tor  N,  O,  tod  P. 


8 

2 

I 


3 

2 

1 
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360°  Steep  Right  Turn  (Instrument) 

Directions  to  Student:  “Make  a  300°  right  turn  with  a  bank  of 
over  30°  at  an  air  speed  of  130  m.  p.  h.  and  come  out  on  a  heading.  Uso 
full  instrument  panel.  You  will  bo  graded  on  variations  in  altitude 
during  turn  and  deviation  from  correct  heading  at  end  of  turn.  If 
your  bank  Jails  to  SO 0  or  below  during  turn ,  you  will  receive  the  lowest 
score.’  ’ 

Scoring  Directions: 

T.  Note  heading  at  begining  and 

end  of  turn.  Record  differ¬ 
ence,  plus  or  minus. 

U.  Noto  starting  altitude  and 

record  maximum  devia¬ 
tion,  plus  or  minus. 


V.  Noto  bank  on  artificial  hori¬ 

zon  and  record  if  bank  falls 
to  30°  or  below  at  any  time 
during  turn  oxcept  on  roll- 
in  and  roll-out. 

Instrument  Let-Down  and  Low  Approach 

Directions  to  Student:  “Make  a  regular  let-down  and  low  ap¬ 
proach  according  to  the  instructions  for  this  test.  Shake  tho  stick  at 
tho  proper  number  of  seconds  after  the  low  cono.  When  you  shake 
tho  stick,  you  will  be  graded  on  whether  you  arc  on  the  beam,  at  tho 
correct  altitude,  at  the  correct  timo  after  tho  low  cone.  Reset  your 

altimeter  to - feet.  You  are  now  on  tho  beam  at  proper  altitude 

about  one  minute  before  the  high  cone  and  headed  toward  it.” 

Scoring  Directions: 

WHEN  STUDENT  SHAKES 
STICK,  CHECK  PILOT 
RECORDS: 

W.  Position. — Plano’s  track  in  W. 

relation  to  ground  markers. 


X.  Time. — Difference  between  X. 

prescribed  interval  ( - 

seconds)  and  student’s 
elapsed  time  past  low  cone. 


Position: 

inside  center  markers 3 

Outside  center  markers 
but  inside  outer  mark¬ 
ers . -  2 

Outside  outer  markers.. -  1 

Time  Difference: 

0-5  seconds . 3 

6-15  seconds _ -----  2 

16  or  more _ _  1 


Circle  proper  number  below: 


T.  Heading  Deviation: 

0°  to  ±  5° .  3 

±6°  to  ±10* .  2 

±  1 1°  and  over.  .  . . .  1 

U.  Altitude  Deviation: 

0  to  ±  50  feet _  3 

±51  to  ±100  feet .  2 

±  101  feet  and  over. ....  1 

V.  Over  30*  Bank: 

Maintained _ _ 3 

NOT  maintained.. _ _  1 
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Y.  Altitude. — Number  of  feet  Y.  Altitude  Difference: 


difference  between  pro-  0-20  feet .  3 

scribed  indicated  altitude  21-GO  feet .  2 

( - ft.)  and  student’s  in-  01  or  rnore  fcct .  * 

dicatcd  altitude. 


ADVANCED  TWO-ENGINE 


A. 

.  B.  .. 

Name:  (Last) 

(First) 

(Middle) 

(Avn.  Cadet  ASM) 

C. 

Date: _ 

Day 

Month 

Class. 
Yw  Don’t 

writo  here:  Secretary  will 

School .  supply  pilot  stanino  (with  credit 


added). 

Place . .  P-fCr: . . 

D.  Did  j  mi  have  any  flying  experience,  handling  tho  controls  of  a 
plane  in  the  air,  bejore  entering  primary  flying  school ?  ( Circls 

the  number  following  the  answer  that  applies  to  you.) 


Soloed  before  entering  primary  school . . - . — .  1 

More  tlmn  4  hours  stick  time  but  never  soloed .  2 

Less  than  4  hours  of  stick  timo . . -  3 


Circle  tho  number  indicating  tho  kind  of  plane  or  planes  on  which 
you  had  your  primary  and  basic  training. 

F.  At  Basic: 

1  BT  (13,  I  f,  15)  and  8  or 

2  -fhoura  AT-0 .  t 

3  BT  (13,  14,  15)  and  8  or 

4  + hours  AT-17  or  UC-  ‘ 

ft  78 .  2 

6  BT  (13,  11,  15)  and  8  or 

+ hours  AT- 10 . Z 

•Only  BT  13,  14,  or  15...  4 

•Only  AT-0. . 5 

•Only  AT-17  or  UC-78..  6 

♦Only  AT-10 .  7 

Other . 8 

•Lcm  than  8  hours  on  olhvt  plana*. 

G.  Circle  the  number  to  indicato  AT-C . 

what  piano  you  used  during  ££10**"’ 
the  10  weeks  of  AD-  aT-17  oV  u<>78 

VANCED  training  bejore  b-25 . 

the  freeze.  Other . 


E.  At  Primary: 

Fairchild  and  Stearman.. 

Ryan  and  Ster.rman _ _ 

Only  Stearman . 

Only  Fairchild - - - 

Only  Ryan . 

Other . 
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H.  Circlo  tho  appropriate  num-  Non® .  0 

bcr  to  indicate  tho  number  ®n<j* .  1 

of  classes  you  havo  been  .  I 

held  over  m  all  phases  of 
training  after  graduating 
from  preflight. 

I.  Reject: 


No. 

Yes. 


1 

2 


Check  Pilot:  Contact. 


Instrument. 


Single-Engine  Procedure 

(At  2,000  ft.  or  more  above  ground) 

Cheek  pilot  sets  up  the  following  conditions: 

1.  Wheels  down. 

2.  Cardinal  heading. 

3.  A/S  exactly  160  m.  p.  h. 

4.  2,200  r.  p.  m.  and  enough  manifold  pressure  to  maintain 
>J0  m.  p.  h. 

“I've  set  up  the  plane  for  single-engine  procedure.  You  will  bo 
graded  on  how  well  you  maintain  heading,  air  speed,  and  altitude." 

When  airplane  and  student  are  ready,  write  down  tho  following 
before  cutting  engine: 

A/S . m.  p.  h.  Altitude . ft.  Heading . 0 

Now,  Check  Pilot  Cuts  Either  Throttle  Completely 
During  the  next  2-minute  period,  circlo  tho  following  deviations: 

J.  IIeadino  (maximum  deviation): 

Stayed  within  ±6°  limits... _ _ _ _ ... — .  3 

Stayed  within  ±  10°  limits _ _ _ _ _ _ .....  2 

Exceeded  ±  10°  limit* . . — ................  1 

K.  Air  speed  (minimum  A/S): 

ISO  m.  p.  h.  and  over . . . . ..............  3 

140  in.  p.  h.  and  over . . . . .  2 

Below  140  m.  p.  h . . . — ....................  1 

L.  Altitude  (maximum  lost): 

Lcbm  than  100  feet. _ ....................  —  - - -  3 

Legs  than  200  feet _ ........ — - .....  — - -  —  .  2 

More  than  200  feet _ ..... — ... - - -  1 

M.  Procedure  check  list:  Did  student  do  ALLof  tho  following  correctly? 

Add  power  immediately........ . . ....] 

Retard  prop  control . —  Yes . .  3 

Retard  correct  prop . .  No...........  1 

Raise  wheels . . 
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Single-Engine  Landing 

On  tho  downwind  leg  after  completion  of  the  GUMP  check,  the 
check  pilot  will  cut  the  inside  engine,  e.  g.,  right  engine  for  right- 
hand  traffic. 

“Fly  the  approach  at  MO  m.  p.  h.  and  make  your  first  contact  in  the 
•  second  zone.” 


Check  Each  Item  as  it  Occurs: 

N.  Turn  onto  approach: 

Lined  up  with  runway. 

O.  A/S  on  approach:  (Maximum 

deviation  from  140  m.p.h.) 

P.  Was  gear  checked  after  lower¬ 

ing  on  approach? 

Q.  Where  was  power  cut  com¬ 

pletely?  (Cheek  nearest  an¬ 
swer.) 

R.  Where  was  landing  contact 

first  made?  (Goal  is  Zone 

2.) 

S.  Landed  in  skid: 


Yes . 3 

No .  1 

±5  m.  p.  h . 3 

±  10  in.  p.  h . 2 

Over  10  in.  p.  h . ! 

Yes .  3 

No .  I 

Roll  onto  approach . 1 

llalf-way  down .  1 

Just  prior  to  round-out .  3 

At  landing . 2 

Zone  1  (first  500  ft.  of  runway)..  2 

Zone  2  (second  500  ft.) .  3 

Zone  3  (third  500  ft.) . 2 

Overshot  or  went  around .  1 

Yes .  1 

No .  3 


Straight  and  Level  Flight  (Instrument) 

“Select  a  cardinal  heading  and  set  up  a  straight  and  level  course  at 
normal  cruising  A/S.  When  you  arc  all  set,  cage  tho  directional  gyro 
and  artificial  horizon  and  continuo  on  course  for  3  minutes.  To  get 


tho  highest  score,  stay  within  tho 

T.  IIeadino  Deviations: 

U.  A/S  Variations: 

V.  Altitude  Variations: 


usual  5-5-50  Jimit3.“ 


Stayed  within  ± 6* .  3 

Stayed  within  ±  10®.  — . 2 

Went  beyond  10® .  1 

Stayed  w  ithin  £5  in.  p.  h .  3 

Stayed  within  ±- 10  in.  p.  h..  — ..  2 

Went  beyond  10  rn.  p.  h .  I 

Stayed  within  ±50  feet .  3 

Stayed  within  ±  100  feet .  2 

Went  beyond  100  feet . I 
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Instrument  Let-Down  and  Low  Approach 

“Mako  a  regular  let-down  and  low  approach  according  to  the 
instructions  for  this  test.  Give  me  a  signal  at  the  proper  number  of 
seconds  after  the  low  cone.  When  you  give  me  the  signal  you  will  bo 
graded  on  whether  you  aro  on  the  beam,  at  the  correct  altitude,  at 
the  correct  time  after  the  low  cone.  .  .  .  You  are  now  on  the  beam 
at  proper  altitude  about  one  minute  before  the  high  cone  and  headed 
toward  it.” 

When  Student  Gives  the  Signal,  Check  Pilot  Records: 

W.  Position. — Plane's  track  in  relation  to  ground  markers: 


Inrtidc  center . 3 

Outside  center  markers  6ut  inside  outer  markers . 2 

Outside  outer  markers _ _ _ _ .  I 

X.  Time. — Difference  between  prescribed  time  ( . seconds)  and 

student’s  elapsed  time  past  low  cone: 

0-5  seconds . . . . . . . .  3 

0-15  seconds . . . . .  . .  2 

10  or  more _ _ _ 1 

Y.  Altitude. — Number  of  feet  difference  between  prescribed  indi¬ 

cated  nltitudo  ( . ft.)  and  student’s  indicated  altitude: 

0-20  feet .  3 

21-40  feet .  2 

Over  40  feet . -  1 


Power-Off  Approach  and  Landing 


“Make  a  power-off  approach  and  landing.  Cut  the  power  com¬ 
pletely  at  traffic  altitude  when  you  think  you  can  land  in  zono  2  with 
power  off  all  tho  way  down.” 


Z.  Altitudo  at  roll  into  tho  approach  varied  above  or  below  the 
altitude  ( . ft.)  by: 


Less  than  100  feet . . . - . 

Tlctwcen  100  and  150  feet... _ _ _ _ 

More  than  150  feet.. . 

AA.^Was  power  added  on  op-  Yes . 

p  roach?  . 

BB.  When  was  contact  first  made?  ^"*3 

Zone  3 _ _ _ 

Over  shot  or  went  around 


3 

2 

1 

1 

a 

2 
a 
2 
1 


TI1E  RELIABILITY  OF  TIIE  OBJECTIVE  MEASURES  USED1 

Tho  fact  that  a  fair  proportion  of  the  measures  used  in  this  study 
show  reliable  differences  between  tho  10  and  15  week  groups,  the 
purpose  for  which  they  wero  designed,  shows  that  they  are  reliable 

1  Thcdwlm  md  lUUstlca!  analysis  of  Ibis  study  were  itipervlscd  by  Lt.I.  K.  Hemphill  and  T/8ft.  W.O. 
Mathrny. 
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enough  for  measuring  group  differences.  In  experiments  which  wero 
auxiliary  to  tho  main  study  it  was  possiblo  to  investigate  further  6omo 
of  tho  measures  in  order  to  determino  whether  or  not  they  wero 
rcliablo  enough  for  uso  in  measuring  differences  between  individuals. 

Observer  Reliability 

Several  of  these  studies  havo  already  been  described  in  chapters  0 
and  7  of  this  report.  They  deal  with  tho  ability  of  tho  check  rider  to 
make  an  accurate  observation  of  the  performance  being  measured.  In 
theso  experiments  tho  scores  of  two  observers  measuring  tho  samo 
thing  at  tho  same  timo  wero  compared.  In  general,  fairly  high 
correlations  were  found  botween  tho  scores  recorded  by  tho  two 
independent  observers.  This  means  that  each  one  of  them  is  ablo  to 
observe  accurately  enough  so  that  his  scores  agreo  with  tlioso  of  tho 
other  observer.  Sinco  a  number  of  different  random  pairings  of 
observers  were  involved  in  each  of  theso  studies,  tho  fairly  high 
correlation  indicates  absoluto  as  well  as  rclativo  agreement. 

Test-Retest  Reliabilities 

Studies  of  test-rctcst  reliability  give  an  cstiraato  of  tho  sum  of  tho 
errors  introduced  by  (1)  tho  observer  and  (2)  tho  variability  of  tho 
performance  itself,  for  example,  tho  day-to-day  differences  caused  by 
changes  in  conditions  such  os  tho  weather. 

Studies  dealing  with  test-retest  reliability  of  objects  o  measures  of 
flying  skill  at  tho  primary  level  and  in  tho  basic  phaso  of  instrument 
flying  have  already  been  described  in  chapters  0  and  9  of  this  volumo. 

Tho  tcst-rctest  reliability  of  each  of  tho  measures  in  tho  check  rido 
administered  to  basic  students  during  tho  training  freezes  was  deter¬ 
mined  by  administering  two  independent  check  rides  to  each  student. 
Tho  two  check  rides  were  given  by  different  check  riders,  in  different 
days,  and  in  different  planes.  A  total  of  102  basic  students  w  ero  used 
in  this  study.  They  wero  tested  at  Goodfellow  Field,  San  Angelo, 
Tex.,  with  a  2-dny  interval  between  test  aud  retest.  Thirty-soven  of 
theso  students  were  tested  in  tho  middle  of  November  1914  after 
having  had  10  weeks  of  training  at  tho  basic  level  and  05  in  tho  middlo 
of  December  after  having  had  15  weeks  of  training  at  tho  ba^ic  level. 

The  tcst-rctest  reliability  of  tho  measures  administered  on  different 
days  was  determined  by  computing  product-moment  correlation 
coefficients  between  the  scores  on  tho  first  and  second  administration. 
In  order  to  get  a  moro  stablo  figure,  tho  two  different  samples  w'ero 
combined  by  uso  of  tho  Fisher  z-transfommtion. 

Sinco  tho  m ensures  w’ero  scored  in  threo  broad  categories,  a  correc¬ 
tion  for  the  cfTcct  of  this  grouping  was  calculated.  This  correction  is 
an  estimate  of  tho  coefficient  of  the  reliability  winch  would  bo  obtained 
if  tho  measures  were  scored  in  tho  finer  categories  of  feet  of  altitudo, 
miles  per  hour,  etc.  Tho  uncorrected  coefficients  give  tho  best  coti* 
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mate  of  tho  reliability  of  the  scale  scored  in  the  three  broad  categories 
used  in  this  study.  Tho  corrected  coefficients  must  bo  used  in  com¬ 
paring  tho  results  of  this  study  with  those  of  others,  such  as  tho  one 
in  chapter  8  of  this  volumo  on  tho  comparison  of  three  different 
methods  of  scoring  instrument  measures,  in  which  tho  measures  were 
not  grouped  in  broad  categories. 

Tho  reliabilities  of  tho  measures  in  tho  basic  check  ride  when  test 
and  retest  wore  given  on  different  days,  with  different  check  riders, 
and  in  different  planes,  are  presented  in  table  AlO.l. 

Table  AlO.l — Test-retest  reliability  of  objective  measure*  of  flying  skill  in  the  basic 

check  ride 


Ooodfcllow— 10  wk  (N« 

-37) 

Oood/cllow— 15  wk  (N> 

-66) 

(N- 

•102) 

Item  measure 

Test 

Retest 

Teat 

Retest 

B  ■ 

r  • 

Mean 

t 

comb. 

eorr. 

8D 

Mean 

SD 

Mean 

SD 

Mean 

8D 

/  Altitude  dovlatlon  180* 

Bi 

0.68 

m 

IE 

m 

m 

0.64 

m 

a  14 

a  10 

steep  turns. 

J  Reached  CO*  bank  180* 

Z  73 

.66 

*# 

R 

K 

w 

if! 

.44 

.13 

.12 

.17 

steep  turns. 

mm 

mm 

K  Zone  piano  lands— accu¬ 
racy  landing,  training 
and  flaps. 

L  Landing  ettltudo— 

L76 

.76 

L95 

.73 

1 

.80 

106 

.90 

.06 

.00 

.13 

102 

.63 

Z70 

.66 

Z76 

Z60 

.66 

-.26 

-.18 

-.34 

accuracy  landing,  train¬ 
ing  and  flaps. 

■ 

Af  Uounccd  or  dropped— 
accuracy  landing,  train¬ 
ing  and  flaps. 

N  Zono  piano  lands— ac¬ 
curacy  landing,  flaps. 

111 

.65 

Z41 

.68 

u 

.76 

Z26 

.77 

.12 

.03 

L70 

.77 

1.81 

.73 

fa 

.78 

1.78 

.73 

f* 

.01 

.03 

0  Landing  attitude— so- 

2168 

.62 

Z66 

.67 

Z74 

Z68 

.61 

■IE 

kz 

.03 

curacy  landing,  flaps. 

P  Uounccd  or  dropped— 

127 

.68 

Z  49 

.76 

m 

i  r 

.71 

Z31 

.80 

m 

m 

.04 

accuracy  landing,  flaps. 
Q  Hoad  deviation— 
straight  and  lovcl  flight 
— Instrument. 

L02 

.78 

Z19 

.69 

.18 

Z 14 

.66 

ZOO 

.78 

.16 

Bt* 

■ 

.23 

R  Air  speed  dovlatlon— 

a  61 

.68 

Z66 

.63 

—.O’ 

Z66 

.63 

Z2S 

.68 

.01 

.00 

straight  and  level  flight 
—Instrument. 

8  Altitude  deviation— 

EL’ 

.64 

ZS6 

.67 

.16 

Z4Sj 

.66 

IE 

.66 

-.09 

M. 

-.01 

straight  nnd  lovcl  flight 
—Instrument, 

T  Ile.ullng  deviation— 3C0* 

Z49 

.64 

Z32 

h: 

■t] 

Z74 

.61 

Z69 

.68 

-.17 

-.11 

ran 

It.  turn— Instrument. 

17  Altitude  dovlatlon— 

1.70 

.67 

1.76 

.71 

.16 

Z37 

.66 

Z23 

.72 

.28 

.34 

.33 

3 Go*  It.  turn— Instru¬ 
ment. 

V Over  30*  bank— 3G0*  It. 

Z78 

.63 

ZOO 

.32 

-.06 

Z8S 

.48 

Z78 

.63 

gWiT1 

-.11 

turn— Instrument. 
IVHcmllngdcvIation— con- 

Z27 

K 

Z38 

.63 

.61 

Z46 

.68 

Z23 

m 

:RJJ 

.18 

.26 

slant  s|Kcd.  Instrument. 
X  Air  si>ced  deviation— 

Z 14 

.62 

Z14 

.47 

-.06 

KE 

.66 

1.97 

.58 

R 

R 

-.05 

constant  speed,  Instru¬ 
ment. 

Hi 

Y  Altitude  dovlatlon— 

Z  61 

2  51 

.66 

.27 

Z76 

.47 

Z6S 

.47 

.14 

.10 

constant  speed  climb 
end  descent— lustra- 

meat. 

«  Combined  r  by  Fisher's  t  transformation.  Tho  two  groups  being  combined  (10  and  15  week)  are  known 
to  bo  dltfcrcnt  but  tho  combined  r  Is  presented  ns  n  convenient  summary  on  tbo  assumption  that  tbs  true 
correlations  Iii  tho  two  croups  nro  not  markedly  different. 

•  Corrected  for  grouping  In  broml  categories;  Fetors  and  Van  Voorhla,  Stathtlcal  Procedures  ani  T Mr 
Mathematical  Uutt,  p.  3VJ,  Formula  211. 

It  can  bo  seen  that  tho  test-retest  reliabilities  of  most  of  the 
measures  in  this  check  ride  were  low.  Tho  two  measures  showing 
tho  best  reliability  coefficients  were:  (1)  Altitude  deviation  in  the 
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instrument  tum,  nnd  (2)  bending  deviation  in  the  instrument  constant 
speed  climb  nnd  descent.  The  reliabilities  computed  from  data 
grouped  into  three  brond  cntegorics  nro  0.24  nnd  0.1S,  respectively, 
for  these  measures.  Corrected  for  grouping  into  brond  cntegorics, 
these  reliabilities  bccomo  0.33  nnd  0.25. 

Theso  results  were  in  lino  with  those  which  have  been  reported  in 
chapter  6  of  this  volume  for  reliabilities  of  the  measures  administered 
to  primary  students  during  the  training  freezes. 

When  a  single  test  and  retest  was  given  on  different  days  in  different 
planes  nnd  by  different  check  riders,  the  reliability  of  most  of  tho 
measures  administered  to  primary  nnd  basic  students  was  relatively 
low.  A  few  of  the  measures  were  reliable  enough  so  that,  if  they  wero 
combined  with  other  good  ones,  the  total  scoro  of  a  singlo  check  rido 
might  show  some  promise  of  being  stable  enough  for  uso  in  measuring 
differences  between  individuals. 
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APPENDIX  TO  CHAPTER  ELEVEN _ 

Fixed  Gunnery  as  an  Objective 
Measure  of  Flying  Skill 


Variation  in  Training  Procedures 

During  tho  Advanced  training  period  the  students  received  ap¬ 
proximately  the  following  pregunnery  instruction  in  tho  Eastern, 
Central,  and  Western  Flying  Training  Commands  for  Classes  44-1-0 
and  44-1-K. 


Eastern 

Central 

We*  tern 

Lecture*  on  gunnery  principle* . 

4-5  hotir* . 

5-ID  boon... .......... 

10  hours. 

Armament . 7. _ .'. . 

4  hour*................ 

10  hours....... . . 

Range  estimation  trainer . 

2-1  hour* . 

1-2  hours... . 

Ounalntructor . 

yi  hour . 

U  hour . 

Kona. 

None. 

Nona, 

Nona. 

None. 

BD  link . 

cno  rounds  • . . . 

200-800  round*  * . 

Skeet . 

100-300  rounds  . 

I'O-OOQ  round*  i....... 

Deflection  training . 

None . . . 

W-2  hour* . . 

Oround  and  acriaf  camera  mission* . 

None . 

3  hour*. . 

i  Rounds  and. 


After  classes  44-1-G  and  44-1-H,  tho  BB  Link  was  discarded  as  a 
training  aid.  Tho  Central  Flying  Training  Command  substituted  a 
hand-held  flcxiblo  gun  in  its  placo.  In  addition,  ono  school  in  this 
samo  command  added  an  optical  sight  to  tho  skcct  gun  used  to  teach 
tho  concept  of  leading  tho  targot. 

In  tho  transition  phaso  each  class  was  divided  into  two  groups: 
ono  was  sent  directly  to  tho  gunnery  training  whilo  tho  other  took 
P-40  transition  training.  After  tho  completion  of  theso  phases  tho 
two  sections  reversed  tho  typo  of  training. 

Tho  ground  school  instruction  given  at  tho  gunnery  schools  may  bo 
summarized  as  follows: 


Eastern 

We:  Urn 

Central 

Lecture*  on  gunnery  principle* . 

12  hour* . 

>0  hour* . 

None . 

•  hour* . 

12  hour*. 

13  hotir*. 

1)  morn  t  rat  Ion  only. 
None. 

1-2  hour* . 

>  hours. . 

1-2  hour*.......... 

Non* . 

During  classes  44-1-G  and  44-1-H,  tho  averago  student  in  Eastern 
fired  1100  rounds  in  air-to-ground  gunnory,  whilo  tho  averago  student 
in  Central  fired  800  rounds  and  tho  averago  student  in  Western  fired 
1300  rounds.  The  ranges,  targets,  and  flight  patterns  used  in  tho 
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three  commands  wcro  essentially  the  same.  The  gun  was  mounted 
in  tho  wing  in  Central,  while  both  Eastern  and  Western  had  the  gun 
installed  in  tho  engine  cowl.  Later  tho  cowl  gun  was  introduced  in 
Central. 

A  "foul”  in  air-to-ground  gunnery  was  declared  when  the  student 
continued  to  firo  after  crossing  the  foul  lino,  600  feet  from  the  target. 
In  Eastern  one  "free”  foul  was  allowed  in  each  practice  mission. 
Otherwise,  tho  rule  was  a  penalty  of  5  percent  of  tho  score  for  each  of 
tho  first  three  fouls  and  a  zero  for  tho  mission  for  the  fourth  foul. 
In  Western,  fouls  were  charged  and  penalized  in  exactly  the  same 
way.  In  Central,  lack  of  supervisory  personnel  made  the  charging 
of  fouls  impossible. 

Lack  of  assessing  equipment  resulted  in  Eastern  students  flying 
only  one-half  of  their  air-to-ground  missions  with  a  camera.  In 
Central,  no  cameras  were  used  in  connection  with  air-to-ground  gun¬ 
nery.  In  Western,  every  mission  was  a  camera  mission. 

Tho  average  student  in  Eastern  flow  16  air-to-air  missions,  firing 
2,100  rounds.  Tho  average  student  in  Central  and  Western  flew  24 
air-to-air  missions  and  fired  2,300  and  2,000  rounds,  respectively. 

Tho  standard  number  of  rounds  loaded  for  a  mission  in  Central 
and  Western  was  100.  In  Eastern,  however,  the  first  mission  waa 
100  rounds  and  all  succeeding  missions  were  200  rounds. 

Tho  standard  flag-typo  target  was  used  in  all  three  commands; 
however,  tho  size  and  design  varied  to  some  extent. 

Tho  student  usually  flew  the  same  plane  on  all  missions  in  Central 
and  Western.  Tho  opposite  held  true  in  Eastern,  where  tho  students 
generally  flow  different  planes  on  successive  missions. 

"Fouls”  in  air-to-air  gunnery  consisted  of  (1)  exceeding  the  allowed 
number  of  passes  at  tho  target  and  (2)  firing  with  less  than  a  30° 
angle  between  tho  bullets’  path  and  the  targot  path.  Tho  same  penal¬ 
ties  woro  called  for  each  foul  in  air-to-air  gunnery  as  in  air-to-ground 
fixed  gunnery.  Fouls  wcro  regularly  charged  in  Western.  In  East¬ 
ern,  fouls  wcro  rarely  charged  and  in  Central  wore  never  charged. 

Generally,  weather  conditions  woro  similar  at  tho  gunnery  ranges 
in  Central  and  Eastern.  Both  were  located  in  sea-level  country 
near  tho  Gulf  of  Mexico.  There  was  considerable  haze,  frequent  fog 
end  rain  during  some  period  of  tho  year.  In  contrast,  weather  con¬ 
ditions  throughout  tho  year  were  nearly  ideal  at  the  gunnery  range 
in  Western  which  was  located  in  semi-arid  land.  Visibility  was 
excellent  and  thcro  was  very  little  rain  at  any  timo  of  the  year.  Only 
from  two  to  seven  days  per  year  were  lost  from  gunnery  firing  due  to 
weather  conditions. 
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Effect  of  Ten  Hours  P-40  Training 

Table  All.l. — Meant,  tigmat  and  critical  ratioi  of  teetioni  vith  and  without  prior 
P-40  training  in  air-to-ground  fired  gunnery  icorti 


Transition  school  Prior  P-40  training  W  M 


Table  All. 2. — 


Meant,  tigmat,  and  critical  ratioi,  with  and  without  prior  P-40 
training  teclioit  in  air-to-air  fixed  gunnery  tcoret 


Transition  school 


Williams. 


Craig... 
8  pence. 
Napier. 
Foster.. 


Aloe... 

Moore. 


Without.. 

With . 

Without.. 

With . 

Without.. 

With . 

Without.. 

With . 

Without.. 

With . 

Without.. 

With . . 

Without.. 
With . 


—39.41 

’—3S.47" 

-3A95 


H  tail 


Ptrtnl 

ti.os  ait  11 

MIS  . . 

6Z  95  13)  41 

3173  . . 

01. 73  AW  41 

41  a  . . . 

44.38  AM  * 


CAM  . ... 

49.38  .  33 

47.19  ........ 

81.30  L39 


44.30  . .......... 


Turbulence  as  Measured  by  Instructor  Ratings 

Table  A11.3.-NV  mean.,  tigmat,  and  critical  ratioi  by  mittioni  and  total  for 

imlructor  ralingt  of  turbulence 


Relation  Between  Time  of  Day  and  Air-to*Air  and  Air-to-Ground  Fixed 
Gunnery  Score# 

Mean  scores  by  time  of  day  were  computed  using  the  time  of  take¬ 
off  as  the  timo  of  tho  mission  and  the  porcont  hits  on  a  singlo  mission 
for  an  individual  student  as  tho  unit  datum  for  both  air-to-ground 
and  air-to-air  gunnery.  For  tabulation  purposes  tho  timo  of  day  was 
divided  into  six  periods  of  two  hours  each. 

Thcro  was  one  factor  which  might  have  given  a  false  appcaranco 
to  such  data.  Thoro  was  tho  tendency  of  the  schools  to  fly  tho  later 
missions  in  each  student’s  series  at  the  time  of  day  judged  to  bo  most 
favorablo  for  obtaining  high  scores.  This  tendency  was  particularly 
prevalent  for  tho  record  missions  which  were  the  lost  two  flown.  It 
was  evident  from  tho  learning  curvo  that  if  the  lator  missions  in  the 
practice  series  wero  flown  predominantly  at  one  poriod  of  tho  day, 
that  timo  of  day  would  bo  expected  to  yield  higher  mean  scores.  There 
was  ovidcnce  that  this  sort  of  scheduling  did  sometimes  occur.  There¬ 
fore,  the  percent  hits  for  each  timo  of  day  was  corrected  for  learning. 

This  was  accomplished  in  tho  following  mannor:  Each  student’s 
missions  wore  numbered  consecutively.  Tho  numbers  of  all  missions 
flown  in  each  two-hour  period  wore  tallied  and  tho  mean  mission 
number  determined.  Tho  mean  percent  hits  to  bo  normally  expected 
for  each  mission  was  dotormined  from  the  combined  learning  curves 
(soo  figures  11.1  and  11.2).  Tho  difference  between  this  figure  and 
tho  percent  hits  oxpcctcd  for  tho  mission  was  then  added  to  (or  sub¬ 
tracted  from)  tho  actual  percent  hits.  That  yielded  tho  mean  percent 
hits  corrected  for  learning. 

Tables  All. 4  and  All.5  present  tho  mean  scores  by  timo  of  day  for 
both  raw  scores  and  scores  corrected  for  learning.  It  must  bo  re- 
mombered  that  tho  times  of  day  Eastern  and  Central  aro  not  directly 
comparablo  sinco  tho  gunnery  school  in  Eastern  was  in  tho  extreme 
eastern  portion  of  tho  Central  War  Timo  zono  and  tho  school  in  Cen¬ 
tral  was  in  tho  western  portion  of  tho  same  zono.  Tho  difference  in 
solar  timo  between  tho  two  places  was  approximately  44  minutes. 


Tadlb  A11.4. — Air-to-ground  fixed-punnery  scores  a*  a  function  of  timo  of  day  and 

mean  mission  by  timo  of  day 


Time  of  day . 

0-1 

M 

10-11 

12-13 

14-15 

16-17 

N 

M 

N 

M 

W 

JV 

U 

N 

M 

N 

M 

CbM  41-1-0  (EFTC)t 

Haw  score* . 

130 

33.83 

163 

29.97 

ICO 

28.76 

72 

25.26 

116 

2100 

232 

3194 

Corrected  scores • . 

130 

34.78 

169 

30.67 

109 

27.01 

72 

27.06 

116 

29.29 

232 

3134 

Clo5s4t-i-it  (Kirro): 

Haw  scores . 

820 

30.63 

660 

30.78 

371 

26.81 

260 

2162 

449 

2124 

464 

30.77 

Corrected  scores  • . . 

820 

23.88 

860 

23.34 

371 

24.31 

260 

24.02 

449 

24.74 

464 

29.57 

ci&m  44-i-j  (i)  (orro): 

IlAur  crorcj . . 

441 

26.70 

370 

20.15 

373 

2162 

436 

24.34 

180 

2132 

Corrected  scores  > . . 

441 

24.80 

370 

24.93 

373 

21.72 

436 

2154 

180 

2122 

•  Corrected  to  lew!  o t  tb*  third  mtoton. 
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Table  A11.5. — Mean  team  by  time  of  day  for  oir-lo-oi'r  fixed  gunnery 


Tim*  of  d»f . 


Clui  0-1-0  (EFTC): 


Clou  44-1-11  (EFTC): 

Raw  loores . 

Corrected  kok*  i... 


8-7 

V4 

10-11 

17  11 

16-18 

S 

71 

M 

N 

s 

— 

M 

tt 

M 

178 

10.0 

_ 

317 

11. 1 

M? 

136 

317 

11.8 

316 

116 

171 

ia  7 

317 

II.  7 

363 

13  3 

311 

116 

3(6 

131 

640 

18.3 

TM 

13.8 

607 

14.0 

695 

li2 

631 

14.8 

13.8 

780 

,4.3 

097 

til 

096 

11 6 

CJI 

131 

i  Corrected  to  fifth  mission  l*r*L 
*  Corrected  to  lUth  mission  tenl. 

Effect  of  Wind  Direction  and  Velocity  on  Air-to*Ground  Fixed  Gunnery 
Score. 

A  record  of  velocity  and  direction  of  the  surfaco  wind  for  each 
mission  was  entered  on  each  student’s  individual  record  sheet  along 
with  tho  percent  hits  obtained  for  tho  mission.  Sinco  tho  wind  data 
was  obtained  from  instruments  located  in  tho  gunnery  field  control 
* jwer,  tho  system  assumed  that  tho  tower  wind  was  tho  samo  as 
that  over  a  gunnery  rango  several  miles  distant  and  at  altitudes  from 
200  to  800  feet.  Without  doubt  thoro  was  somo  error  in  that  as¬ 
sumption;  howover,  the  wind  conditions  in  tho  two  locations  should 
havo  been  sufficiently  similar  to  justify  tho  study.  No  method  of 
determining  tho  surfaco  winds  was  available  at  tho  ronges  themselves. 

Wind  direction  relative  to  tho  direction  of  divo  on  tho  target  was 
divided  into  head,  tail,  right  cross,  and  left  cross  wind.  It  was  de¬ 
termined  that  a  30°  variation  in  wind  direction  from  tho  central  lino 
of  each  direction  would  not  greatly  affect  tho  wind  vector  acting  on 
tho  piano.  This  division  of  wind  directions  accounted  for  four  arcs 
of  60°  each,  and  left  four  intermediate  arcs  of  30°  each  for  which  tho 
wind  direction  was  judged  to  bo  ambiguous  and  so  was  not  considered 

in  this  analysis.  .  ......... 

After  inspection  of  tho  data,  wind  velocities  wero  divided  into  0 

categories  of  miles  per  hour:  1-5,  0-10,  11-15,  10-20,  21-25,  20-30. 
Left  and  right  cross  winds  were  combined  after  a  preliminary  analysis 
showed  no  diffcrcnco  in  their  effect.  Tho  mean  percent  hits  for  each 
velocity  of  each  wind  direction  was  then  determined.  Sinco  somo 
wind  directions  and/or  velocities  might  have  been  more  prevalent  at 
ono  stago  of  training  than  at  another,  tho  scores  wero  corrected  for 
learning.  This  correction  was  a  linear  ono  sinco  tho  assumption  .of 
a  linear  learning  relationship  was  tho  only  ono  which  did  not  reduco 

tho  reliability  of  tho  corrected  score.  .  ,  ..  . 

Tablo  A11.0  presents  tho  mean  percent  bits  by  wind  direction  and 
velocity  for  tho  Pro  and  Post  P-40  sections,  separately  and  combined, 
for  Class  44-1-J  in  tho  Central  Flying  Training  Command. 


Table  All. 6.— -Mean  percent  kite  by  wind  direction  and  velocity  for  two  tectione 
with  and  without  prior  P~40  training,  eeparalelu  and  combined  for  clan  44-1-J 
in  CFTC 


Without  P-40 
train  leg 


Unoor* 
N  rected 
M 


With  P-40  training  Combined 


Unoor-  Cor*  Unoor*  Cor¬ 
rected  r acted  N  reeled  racted 

MM*  MM* 


90.0  33.0 

30.0  34.0 

37.0  33.3 

7  1  30.4  33.3 

90  91.3  U.S 


104  44.0  4X7 
974  4X0  4X3 


31.0  2X0 

41  91.0  97.3 
137  I  2X3  3X0 


30.0  1X0 


>  Corrected  for  laarnlng. 


Correction  of  Air-to-Ground  Fixed-Gunnery  Scores  for  Variation  in 
Wind  Direction  and  Velocity 

Tho  data  used  were  those  introduced  in  the  preceding  section,  i.  e.» 
Class  44-1-J  in  Central.  Using  the  data  for  the  Pre  P-40  section  of 
that  class,  a  set  of  curves  of  moon  scores  for  wind  direction  and 
velocity  wore  made.  It  was  assumed  from  inspection  of  the  data 
that  cross  and  tail  winds  (as  defined  in  tho  preceding  section)  had  the 
samo  not  effect  on  gunnery  scores.  Therefore,  the  two  curves  were 
combined  to  determine  a  new  curve,  which  was  projected  to  zero  wind 
velocity. 

Since  no  missions  wero  flown  in  head  winds  of  less  than  11-15  mile# 
per  hour,  it  was  necessary  to  estimate  part  of  the  head  wind  curve. 

Two  conversion  tables  wero  made  on  the  basis  of  the  abovo  curves  to 
correct  individual  scores  obtained:  (1)  whilo  flying  in  any  given  cross 
wind  or  tail  wind  and  (2)  whilo  flying  in  any  given  head  wind,  to  those 
that  would  bo  expected  had  tho  mission  been  flown  in  tho  optimum 
head  wind.  These  conversions  were  equal  to  tho  actual  difference  in 
percent  hits  between  tho  expected  score  for  any  given  velocity  and 
direction  of  wind  and  tho  optimum  head  wind.  The  assumption  of  a 
linear-typo  relationship  was  based  on  experimentation  with  soverol 
methods  of  correction.  The  assumption  of  linear  relationship  was 
tho  only  one  which  kept  converted  scores  within  possible  limits,  i.  e., 
did  not  predict  scores  of  ovor  100  percent  hits. 

With  these  two  conversion  tables,  tho  individual  scores  obtained  by 
the  students  in  the  Post  P-40  section  of  class  44-1-J  were  corrected 
for  tho  wind  direction  and  velocity  in  which  they  wero  flown.  The 
odd-oven  reliability  of  these  converted  scores  and  also  of  tho  raw 


1 


scores  on  which  they  wero  based  was  determined.  Tablo  A11.7 
presents  these  data. 


Table  A 11. 7. — -Maasj,  standard  deviation!,  and  reliabilities  for  the  rate  scores, 
rcyctcorreetedfor  wind  direction  and  velocity,  for  poet  P-40  lection ,  date  44-t-J, 


Type  won 

* 

A i 

8D 

r'n 

ru 

Raw  (corac 

Odd . . . 

263 

43.22 

60.33 

76.33 
13.11 

It.  14 

31.90 

29.33 
29.  M 

ft  63 

ft  99 

E»cn . . . 

Corrected  scorer. 

Odd . 

263 

.47 

.64 

Even.. . 

Table  A11.8. — Correlation  of  instructor  ratings  of  pilot  proficiency  and  fixed-gunnery 

scores 


Type  of  gunnery 

Ounncry  scone 

Instructor  ratings 

Correia* 

lion 

N 

AT 

8D 

M 

8D 

with 

rating 

A!r-to-fmand _ _ _ 

■n 

31.07 

1130 

1.63 

0.67 

Iftll 

ilrJiulr  _ _ _ _ _ 

170 

1.63 

.67 

1.33 

md 

>  Sign  changed  to  Indicate  assodat.'  >n  of  "food’*  performance 
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Glossary 1 


SYMBOLS 


BtUtU  ■  •  •  i 


C 

CR 

F-xt'Xo 


I 

M 
N 
Nt 
N , 
Nt 
Nn 
P 
P. 
0 

P . 
R 


r 

VkU 

f 

r»Mi 

rut 

r. 

r»ir 

rif 

SZ> 

0 

SB 

W 

X 


—  Bet*  weight. 

—Cocflicicnt  of  contingency. 

■—Critical  ratio. 

■■Ratio  of  the  larger  variance  to  the  smaller  variance.  See 
Analysis  of  Variance. 

— Claes  interval. 

—  Mean  (average). 

— Number  of  cases. 

■—Number  of  eases  eliminated. 

■■Number  of  cases  graduated. 

•■Number  of  eases  in  iower  group. 

— Number  of  eases  in  upper  group. 

■•Significance  level. 

■•Percentage  eliminated. 

■■Phi  cocflicicnt  (Pearson  r  from  a  2  z  2  table). 

■■Percentage  graduated. 

—  Multiple  correlation  cocflicicnt,  also  number  of  right  answers  In  a 

scoring  formula. 

—Pearson  product-moment  cocflicicnt  of  correlation. 

—  Biscrial  correlation  coefficient. 

—Correlation  cocflicicnt  corrected  for  restriction  of  range. 

—Point  biscrial  correlation  coefficient. 

— Tctrachorie  correlation  cocflicicnt. 

—Correlations  combined  by  Fisher’s  i-trnnuformatloa  which  is  the 
correct  method  for  averaging  correlations. 

—Correlation  between  odd  and  even  scores  or  two  halves  of  a  test 
without  Spearman-Brown  correction  for  full  length. 

—  Reliability  coefficient  with  Spearmnn-Brown  correction  or  where 

correction  Is  not  necessary. 

—Standard  deviation. 

—Standard  deviation. 

—Standard  error. 

—Number  of  wrong  answers  in  a  scoring  formula. 

—Raw  score. 

TERMS 


AAF  Regulation  50-3.— An  AAP  regulation  which  governs  tho  Issuance  of 
instrument  certificates  to  rated  pilots.  It  specifics  tho  requirements  of  the 
written  and  flight  checks  which  all  pilots  arc  required  to  pa«s  annually  to 
maintain  the  instrument  ratings  which  allow  them  to  fly  in  bad  weather. 

Aerobatics. — Maneuvers  such  os  loops,  rolls,  spins,  etc. 

Advanceo  Tbainino.— Tho  final  10-week  phase  of  pilot  training  before  the 
student  receives  his  wings  and  commission.  Ho  receives  instruction  in  heavier 
and  more  powerful  aircraft  and  completes  tho  formation,  navigation,  Instru¬ 
ment,  etc.,  phases  which  ho  began  in  basic  training.  (See  Primary,  basic.) 


•  Opt.  William  V.  Dtila  ni  primarily  responsible  lor  Ibis  glossary. 
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Aileron. — A  control  surface,  a  hinged  segment  of  the  trailing  edge  of  the  wing, 
which  maintains  the  lateral  stability  of  tho  aircraft.  Moving  the  control  otick 
raises  ono  aileron  and  lowers  the  other,  thus  banking  tho  plane  to  right  or  left. 

Am  Speed. — Tho  velocity  of  an  aircraft  through  the  air  mass. 

Air-Speed  Indicator. — An  instrument  which  measures  the  speed  of  an  aircraft 
through  tho  air  moss. 

Altimeters. — Instruments  which  can  be  set  to  indicate  the  altitude,  in  feet, 
abovo  sea  level  or  specified  ground  check  points. 

Analysis  or  Variance. — Statistical  methods  for  segregating  from  comparable 
groups  of  data  the  variance  in  the  dependent  variable  traceable  to  specified 
sources. 

Angle  or  Attack. — The  angle  at  which  tho  wing  meets  the  air.  Increasing  the 
angle  of  attack,  up  to  tho  stalling  point,  increases  the  lift  produced  by  the  wing. 

Anole  or  Bank. — Tho  angle  between  the  horizon  and  a  line  passing  through  the 
wing  tips.  In  level  flight  it  is  0°,  in  a  gentle  bank  it  is  approximately  15°,  and 
in  a  vertical  bank  it  is  00*. 

Approach,  Instrument. — An  instrument  flight  procedure  for  descending  through 
an  overcast  In  order  to  mako  visual  contact  with  the  ground  over  a  specified 
location. 

Approach,  Landing. — A  straight  glido  toward  the  near  end  of  the  landing  field 
or  runway. 

Artificial  Horizon. — A  gyroscopic  instrument  which  shows  the  position  of 
the  aircraft  with  relation  to  the  horison. 

A/8. — An  abbreviation  for  air  speed. 

AT-8. — A  single-engine,  low-wing  monoplane  with  tandem  dual  controls,  retract¬ 
able  landing  gear,  power-operated  flaps,  and  constant-speed  propeller.  Cruis¬ 
ing  speed  150-160  m.  p.  h.  Used  extensively  as  an  advanced  and  basic  trainer. 

AT-9,  AT-10,  AT-17. — Two-engine,  low-wing  monoplanes  with  side-by-side  dual 
controls,  retractable  landing  gear,  power-operated  flaps,  and  constant-speed 
propellers.  Cruising  speed  approximately  150-160  m.  p.  h.  Used  as  two- 
engine  advanced  trainers  until  replaced  by  the  TB-25. 

Attenuation,  Correction  for. — A  correction  applied  to  estimate  what  tho 
correlation  between  two  variables  would  bo  if  chanco  errors  in  the  measurement 
of  tho  two  variables  could  be  eliminated. 

Attitude,  Flight. — Tho  position  of  the  aircraft  in  relation  to  tho  horizon  or 
ground.  For  cxamplo,  when  tho  noso  of  an  aircraft  is  well  above  the  horizon, 
it  is  said  to  bo  in  a  noso-high  attitude. 

Ball-Bank  Indicator. — A  dual-purpose  instrument  which  has  a  free-moving 
ball  for  indicating  slipping  or  skidding  and  a  needle  which  shows  rate  of  turn. 

Bank,  or  a  Plane.— Sco  Anglo  of  bank. 

Base  Leg.— Sco  Pal  tern,  traffic. 

Basic  Instruments.— Those  instruments  which  are  fundamental  to  maintaining 
safe  flight  when  rcfcrcnco  to  tho  horizon  and  other  normal  cues  is  prevented  by 
clouds,  darkness,  or  tho  cloth  hood. 

Basic.— Tho  intermediate  10-wcck  phase  of  flying  training  which  includes  transi¬ 
tion  to  heavier  aircraft  (BT-13,  AT-G)  beginning  instrument  flying,  formation, 
and  cross-country  navigation,  (Sco  Primary,  advanced.) 

Battery,  Test.— A  group  of  tests  covering  a  variety  of  subjects,  or  aspects,  of  a 
given  field. 

Beta  Weight.— A  numerical  value  indicating  the  relative  importance  of  a  single 
varinblo  with  respect  to  other  variables  when  the  several  variables  are  combined 
to  predict  a  criterion  most  effectively. 

BT-13,  BT-1 5.— Single-engine,  low-wing  monoplanes  with  tandem-dual  controls, 
fixed  landing  gear,  manually  operated  flaps,  and  two-speed  propellers.  Cruising 
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thoCAT-^~140  m  P  h*  U6Cd  ft*  the  8lAndftrd  bAsio  trft*ncr  replaced  by 

Cadets,  AviATio.v.—Studcnts  in  preflight  or  actual  flying  training  leading  to  com. 
mission  as  rated  aircrew  officers.  Commissioned  officers  taking  the  same  train, 
lng  arc  designated  “Student  officer*." 

Central  Fltino  Trainino  Command. — A  regional  branch  of  tho  AAF  Trainin* 
Command.  (See  chap.  2.) 

Central  Instructors  Schoou  (C.  I.  S.).— Schools  which  trained  Instructor* 
for  all  the  schools  in  a  command  and  thus  helper!  to  achieve  standardization  of 
procedures  and  methods  of  instruction.  Contrasted  with  local  instructor 
squadrons  which  trained  instructors  only  for  their  own  school. 

Chandelle.— A  climbing  turn  in  which  tho  student  was  required  to  gain  the 
most  altitude  possible  without  stalling  while  turning  ISO*. 

Check  List,  Procedure. — A  list  of  specific  operating  procedures,  carried  In 
every  plane,  to  be  used  by  the  pilot  (1)  beforo  starting  the  engines,  (2)  during 
warm-up,  (3)  before  take-off,  (4)  during  flight,  (5)  before  landing,  and  (0)  after 
landing.  All  pilots  were  required  to  use  the  check  list,  regardless  of  how 
familiar  they  were  with  the  equipment,  to  avoid  errors  of  omission. 

Class  Interval. — One  of  the  groups  into  which  the  individuals  measured  on  a 
given  variable  may  be  divided  for  convenience  of  tabulation  and  analysis.  For 
example,  in  tabulating  the  heights  of  pilots  in  a  school,  they  might  be  grouped 
in  class  intervals  of  >4  Inch. 

Classification  Testing  Program.— The  AAF  aptitudo  testing  program  In 
which  potential  air-crew  members  were  tested  and  ranked  in  nine  categories, 
stanincs,  on  their  aptitude  for  pilot,  bombardier,  and  navigator  training. 

Coefficient  of  Continoenct,  Mean  Square. — A  measure  of  degree  of  associa* 
tion  between  two  variables,  when  each  is  expressed  in  several  categories. 

Confidence  Level.— Sec  Significance  level. 

Compass,  Gtro.— A  gyroscope-stabilized  compass  which,  when  set  with  the 
magnetic  compass,  gives  an  accurate  reading  of  heading  which  is  not  subject  to 
the  acceleration  and  turning  errors  of  the  magnetic  compass. 

Compass,  Magnetic. — An  instrument  which  indicate*  magnetic  direction,  or 
bearing. 

Contact  Flight.— Flight  conducted  in  such  a  manner  that  ground  and  water  can 
at  all  times  be  used  for  visual  reference. 

Coordination.— The  correct,  simultaneous  operation  of  the  flight  controls.  Tho 
term  is  most  often  applied  to  the  proper  use  of  the  aileron  and  rudder  in  rolling 
into  or  out  of  turns  without  slipping  or  skidding.  It  may,  however,  indudo  tho 
simultaneous  use  of  additional  controls  such  as  throttlo  and  elevator. 

Co-Pilot. — The  pilot,  usually  seated  on  tho  right  sido  near  the  engino  instru¬ 
ments,  whose  chief  responsibility  is  serving  as  an  assistant  to  the  first  pilot. 

Correlation  Coefficient  (r).— A  numerical  index  of  tho  degree  of  relationship 
between  two  variables.  The  correlation  coefficient  may  vary  from  0.00,  In¬ 
dicating  no  relationship,  to  +1.00,  indicating  perfect  agreement,  and  —1.00, 
indicating  perfect  inverse  agreement.  The  term  “correlation"  or  “correlation 
coefficient,"  used  without  qualification,  implies  the  Pearson  product-moment 
coefficient. 

ConRELATioN  Coefficient,  Biserial  (r»„). — An  expression  of  relationship  be¬ 
tween  two  variables,  one  of  which  is  measured  on  a  continuum  (c.  g.  test  scores) 
while  the  other  is  a  dichotomy  (e.  g.  success  or  failure  on  a  task).  If  tho  distri¬ 
butions  of  scores  are  normal,  the  biscrial  coefficient  is  equivalent  to  tho  product- 
moment. 

Correlation  Coefficient,  Multiple  (/l). — An  expression  of  tho  relationship 
between  one  variablo  and  the  combined  cfTcct  of  several  others  so  weighted  as 
to  maximizo  tho  resulting  coefficient. 
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Correlation  Coefficient,  Pearsonun  or  Product-Moment  (r). — An  expres¬ 
sion  of  relationship  between  two  v/  ables  which  arc  expressed  in  quantitative 
terms,  i.  o.,  a  Bet  of  continuous  measurements  of  the  function  or  attribute 
concerned. 

Correlation  Coefficient,  Phi  (*).— An  expression  of  relationship  between 
two  variables,  neither  of  which  are  assumed  to  be  continuous  and  both  of  which 
aro  expressed  in  dichotomies. 

Correlation  Coefficient,  Point-Biserial  (%*,). — An  expression  of  the  rela¬ 
tionship  between  two  variables,  one  of  which  is  continuous  and  the  other  of 
which  is  expressed  as  a  dichotomy  and  is  not  assumed  to  be  continuous. 

Correlation  Coefficient,  Tetrachoric  (rM). — An  expression  of  relationship 
between  two  continuous  and  normally  distributed  variables  which  are  expressed 
in  dichotomies.  If  the  distributions  are  normal,  the  tctrachorio  is  equivalent  to 
tho  product-moment. 

Correlation  Matrix. — A  tabular  arrangement  of  correlations  of  several  varia¬ 
bles  with  each  other. 

Crab. — See  Drift  Correction. 

Criterion. — The  standard  by  which  tests  or  measures  are  evaluated. 

Critical  Ratio. — The  difference  between  two  comparable  statistics  (correlation 
coefficients,  means,  etc.)  divided  by  the  standard  error  of  that  difference.  An 
index  of  the  reliability  of  the  difference. 

Cross  Wind  Landing. — Landing  of  an  aircraft  other  than  directly  into  the  wind. 
'The  drift  caused  by  the  side  wind  necessitates  corrective  action  by  the  pilot  in 
order  to  maintain  a  straight-in  approach. 

Curve  or  Pursuit. — The  flight  path  of  an  aircraft  attacking  an  aerial  target 
which  enables  the  attacking  airplane  to  keep  the  target  constantly  under  fire. 

Directional  Gtoo  (D/G).— See  Compass,  gyro. 

Director  or  Fltino.— The  officer  responsible  for  station  flying  training  activi¬ 
ties. 

Director  or  Training. — The  officer  responsible  for  station  training  activities, 
including  both  ground  school  and  flying  training. 

Distribution. — A  systematic  arrangement  or  tally  of  the  range  of  scores  based 
on  magnitude.  For  example,  a  distribution  of  height  measures  on  a  population 
would  show  tho  number  of  cases  felling  in  each  unit  interval  ranging  from  the 
lowest  to  tho  highest. 

Downwind. — Flight  of  an  aircraft  in  the  same  direction  as  that  of  the  wind. 

DniFT. — Tho  angular  difference  between  tho  aircraft  heading,  or  direction  it  is 
pointing,  and  its  track,  or  tho  path  it  is  traveling  over  the  earth's  surface. 
This  difference  is  due  to  the  effect  of  the  wind  and  its  magnitude  depends  upon 
tho  direction  and  forco  of  the  wind. 

Drift  Correction. — To  counteract  tho  effect  of  wind  drift  (sco  Drift)  the  air¬ 
craft  must  be  turned  into  tho  wind  a  sufficient  number  of  degrees  so  that  it  will 
follow  tho  desired  path  over  the  earth’s  surface.  The  number  of  degrees 
turned  is  called  tho  drift  correction,  or  crab. 

Dual  Flight. — Flight  by  a  student  pilot  and  instructor  in  aircraft  equipped 
with  dual  controls. 

Eastern  Fltino  Training  Command. — A  regional  branch  of  the  AAF  Training 
Command.  (Sco  chap.  2.) 

Elevator. — Tho  hinged  portion  of  the  horizontal  stabilizer  which  controls  climb 
or  divo  of  tho  aircraft. 

Elimination.— As  used  in  this  volume,  relief  from  flying  training  for  flying 
deficiency.  Generally  used  to  include  relief  from  training  for  any  cause. 

Factor. — A  basic  trait  or  ability,  the  presence  of  which  in  combination  with  other 
traits  or  abilities,  accounts  for  the  relationship  between  two  variable*. 
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Factor  Analysis.— A  statistical  technique  which  resolves  a  set  of  descriptive 
variables  into  a  smaller  number  of  fundamental  categories  or  factors  by  an 
algebraic  analysis  of  the  intcrcorrelations  of  the  variables. 

Feel. — See  Sustentatlon.  . 

First  Pilot.— The  pilot,  usually  seated  on  the  left  side  of  the  aircraft  near  the 
flight  instruments,  who  is  in  command  of  and  chiefly  responsible  for  the  opera¬ 
tion  of  the  aircraft.  .  .  .  .  „ .  . 

Flaps.— A  section  of  the  trailing  edge  of  the  wing  which  may  be  raised  or  lonerod 

to  decrease  or  increase  the  lift  of  the  airfoil.  Flaps  are  most  frequently  usedto 
assist  in  take-off,  steepen  the  glide  angle  during  landing,  lower  the  landing  speed 

of  the  aircraft,  and  reduce  length  of  roll  after  landing.  . .  .. 

FoncED  Landing.— An  emergency  landing  caused  by  engine  or  structural  failure, 

Formation  Flying.— The  flying  of  two  or  more  aircraft  in  close  proximity  so 
that  the  several  aircraft  are  flown,  in  effect,  as  a  single 
serves  to  concentrate  offensive  and  defensive  firepower.  (See  figs.  3.3,  3.4, 

and  3.5.) 
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Landino  Gear,  Tricycle. — The  typo  of  landing  wheel  arrangement  found  on 
most  large  aircraft.  The  two  main  wheels  are  behind  the  center  of  gravity  and 
tho  third,  or  nosc-whccl,  is  ahead  of  the  center  of  gravity. 

Landino,  3-Point. — A  landing  in  which  all  three  wheels  touch  the  ground  approxi¬ 
mately  simultaneously. 

Landino,  Wheel. — A  landing  in  which  the  two  main  wheels  touch  the  ground 
before  the  noce  or  tall  wheel. 

Lazy  EianTS. — A  training  maneuver  in  which  the  nose  of  the  aircraft  trace*  a 
horizontal  figure  eight,  half  of  which  is  above  the  horizon,  and  the  other 
below. 

Level  or  Significance. — Bee  Significance  level. 

Link  Trainer. — A  training  apparatus  which  consists  of  a  mock-up  aircraft 
equippod  with  a  complete  set  of  operating  flight  controls  and  instruments. 
Thus  it  is  possible  to  simulate  some  of  the  conditions  of  instrument  flight 
without  leaving  the  ground. 

Maneuver. — A  finite  unit,  or  portion,  of  the  pilot’s  task  such  as  a  steep  turn,  a 
lazy  eight,  a  loop,  etc. 

Mean. — The  arithmetic  average  of  a  set  of  values. 

Needle  Ball. — See  Boll-bank  indicator. 

Normalization. — Tho  fitting  of  a  given  group  of  scores  to  a  normal  distribution. 

Objective  Measures. — Measures  which  are  defined  in  terms  of  a  permanent 
standard,  such  as  a  reference  point  on  the  airplane  or  an  instrument  reading, 
which  is  tho  same  for  everyone  and  thus  produces  absolute  (in  addition  to 
relative)  agreement  among  observers.  (See  chap.  4.) 

Operational  Training. — The  pre-combat  training  given  assembled  air  crews 
after  graduation  from  tho  Training  Command. 

Partial  Panel. — Instrument  flight  in  which  the  flight  indicator  and  directional 
gyro,  or  other  instruments  are  covered  so  that  they  cannot  be  used  for  reference. 
It  is  more  difficult  than  "full  panel"  because  the  instruments  remaining  do  not 
give  tho  instantaneous  picture  of  flight  attitude  that  is  given  by  the  gyro 
instruments. 

Pattern,  Traffic. — A  rectangular  pattern  flown  by  aircraft  landing  or  taking  off 
from  an  airport.  It  is  composed  of  four  legs:  take-off  leg,  cross-wind,  down¬ 
wind,  base  leg,  and  final  approach  (both  take-off  and  final  approach  are  up-wind 
legs).  Tho  pattern  is  used  to  obtain  uniformity  of  flight  path  and  to  alleviats 
traffic  congestion.  (See  fig.  8.1,  chap.  8.) 

P.  I.  F. — Pilot's  Information  File. — A  manual  of  general  instructions  and 
information  for  all  pilots  kept  up  to  date  by  periodic  revisions. 

Primary  Training. — Tho  first  10-wcck  phase  of  military  flight  training.  Em¬ 
phasis  was  placed  on  elementary  flying  abilities  and  judgment. 

Procedure  Checklist. — See  Checklist. 

PT-13,  PT-17. — Single-engine  biplano  with  tandem  dual  controls.  Fixed 
landing  gear,  no  flaps,  and  fixed-pitch  propeller.  Cruising  speed  approximately 
00  m.  p.  h.  Used  extensively  as  primary  trainers. 

PT-10. — A  einglo-cngino  low-wing  monoplane  with  tandem  dual  controls,  fixed 
landing  gear,  and  fixed  pitch  propeller.  Cruising  speed  approximately  00 
m.  p.  h.  Used  as  primary  trainer. 

Random  Sample. — Sampling  of  a  population  on  a  chonco  basis  as  in  Selective 
Scrvico  drawing  for  draft  numbers. 

Ranoe. — Tho  diffcrc^co  between  tho  highest  and  lowest  score  for  a  group. 

Rated  Work  Sam  ple. — Tho  performance  is  divided  into  a  number  of  specifio 
aspects  or  subtasks,  each  one  of  which  is  rated  separately,  for  example,  the 
student  might  bo  rated  Excellent,  Good,  or  Fair,  on  his  use  of  throttle-to-check 
approaching  stall  in  slow  flying.  (See  chap.  4.) 
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Raw  Scores. — Tho  score  as  originally  obtained  from  the  teat  or  other  measuring 
device. 

Reliable  Difference.' — A  difference  of  such  a  magnitudes  that  it  is  unlikely 
that  it  could  have  been  produced  by  chance. 

Reliability  (rn). — The  consistency  of  a  ineasuro  as  determined  in  one  of  the 
following  ways: 

Test-Retest. — determined  by  correlating  two  administrations  of  tho  test. 

Odd-Even.— determined  by  correlating  tho  averago  of  tho  odd-numbered 
items,  trials,  or  measures  with  tho  average  of  tho  even-numbered  ones. 

Split-Half.— determined  by  correlating  first  half  of  test  with  second  half 
of  test. 

Split-Group. — obtained  by  correlating  ratings  on  the  samo  individual  made 
by  two  independent  groups  of  raters. 

Hott  Method.— determined  by  analysis  of  varianco;  docs  not  require 
Spearman-Brown  correction. 

Reliability,  Correction  for  Double  Lenotii. — Tho  Spearman-Brown  correc¬ 
tion  to  estimate  tho  reliability  of  the  total  group  of  items  or  judges  from  tha 
correlation  between  two  equal  subdivisions  of  tho  group. 

Restriction  of  Range,  Correction  for. — When  tho  rango  of  a  population  la 
restricted  by  selection,  the  correlation  between  two  variables  may  bo  corrected 
for  restriction  of  range  in  order  to  estimate  what  tho  correlation  would  have 
been  if  tho  rango  had  not  been  restricted. 

Rudder. — Tho  hinged  portion  of  tho  vertical  stabilizer  which  maintains  directional 
control  of  tho  aircraft. 

Significance  Level. — A  statement  of  the  statistical  reliability  of  a  finding.  For 
example,  tho  5  percent  significance  level  means  that  the  result  obtained  would 
bo  expected  to  occur  by  chance  only  5  (or  fewer)  times  in  100;  tho  1  percent  lovcl 
means  that  result  would  be  expected  by  chance  not  more  than  1  time  in  100. 

Significant  Difference. — A  difference  which  is  of  such  magnitudo  that  it  is 
unlikely  that  it  could  have  been  produced  by  chance. 

Single-Engine  Operation  (2-Engine  Aircraft).— Tho  emergency  operation 
of  two-engino  aircraft  on  only  ono  of  tho  engines. 

Slow  Flyino. — A  condition  of  flight  In  which  tho  aircraft  U  flown  between  tha 
power-on  and  tho  power-off  stalling  speed  by  tho  use  of  flaps  and  power.  Useful 
in  short-field  landings,  etc.,  where  a  slow-spccd  ground  contact  is  desired. 

Solo. — Flight  by  a  student  or  students  not  accompanied  by  an  instructor. 

Spin. — A  “top-liko”  rotation  of  an  aircraft  about  its  vertical  axis  which  occur* 
when  one  wing  is  stalled  and  tho  other  only  partially  stalled.  Tho  drag  on  tha 
stalled  wing  is  greater  than  that  on  the  other,  creating  a  strong  turning  tendency. 

Stall. — A  condition  in  which  tho  smooth  flow  of  air  over  tho  wing  is  disrupted  so 
that  the  lift  of  the  wing  is  decreased  and  its  drag  increased.  Stalls  are  caused 
by  too  low  an  air  speed  in  relation  to  tho  wing  loading. 

Standard  Deviation  (S.  D.).— A  measure  of  the  degree  of  dispersion  of  a  group 
of  measures  around  tho  mean.  One  S.  D.  in  both  directions  from  tho  mean 
includes  approximately  68  percent  of  tho  population  in.  a  normal  distribution. 

Standard  Score. — A  raw  r>coro  converted  to  units  of  ono  standard  deviation  or 
somo  constant  fraction  of  a  standard  deviation.  By  using  standard  score*, 
measures  of  dissimilar  characteristics  such  as  height  and  weight  may  b# 
compared. 

Standardization  Board.— A  Board  of  officers  tho  purposo  of  which  is  to  maintain 
standardized  training  methods. 

Stanine. — Standard  scores  on  a  normalized  0-polnt  scalo.  Tho  highest  4  percent 
of  tho  scores  receive  a  stanino  of  0,  tho  next  highest  7  percent  a  stanino  of  8, 
etc.,  down  through  12  pcrccntr  17  percent,  20  percent,  17  percent,  12  porcent. 
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7  percent,  to  the  lowest  4  percent  which  receive  a  stanino  of  1.  Two  of  the 
common  forms  of  stanlne  are: 

Pilot. — A  0-point  scale  (based  on  the  weighted  scores  of  a  battery  of  per¬ 
formance  tests)  for  predicting  the  aptitude  of  students  for  pilot  training. 

Instructor. — A  score  to  predict  aptitude  for  teaching  flying. 

Stearman. — Sco  PT-13,  PT-17. 

Stick. — The  cockpit  control  lever  which  operates  the  ailerons  and  elevators. 

Subjective  Measures. — Measures  which  are  made  in  terms  of  judgments  such 
as  “poor"  or  "too  slow”  which  are  dependent  on  thu  standards  of  the  individual 
making  the  judgments.  (See  chap.  4.) 

8ustentation. — A  feeling  of  support  such  as  that  experienced  when  seated  in  a 
chair.  This  feeling,  although  not  reliable,  helps  the  pilot  maintain  flight 
attitudes  since  changes  in  attitude  are  indicated  by  changes  in  feeling  on  the 
"scat  of  the  pants.”  For  example,  in  entering  a  climb,  the  pilot  feels  pushed 
down  in  the  scat,  while  in  lovcling  out  or  in  beginning  a  dive,  he  fcols  lighter. 

Tachometer. — An  instrument  which  indicates  the  speed  In  r.  p.  m.  Since 
engine  power  is  a  function  of  r.  p.  m.  (with fixed-pitch  propellers),  the  tachom¬ 
eter  also  indicates  power  output  of  the  engine. 

Taxi;  Taxiing. — Ground  operation  of  an  aircraft  as  in  going  from  the  parking 
mat  to  take-off  position. 

TB-25. — The  trainer  version  of  the  B-25  (Mitchell)  Bomber.  Lightened  by 
being  stripped  of  all  combat  equipment,  the  TB-25  was  used  as  tho  standard 
2-cngino  Advanced  trainer  during  the  last  years  of  the  war. 

Test  Battert. — 8oe  Battery. 

Test-Retest  Reliability. — The  correlation  between  one  administration  and 
a  second  administration  of  the  same  test.  I 

Torque. — To  the  pilot,  the  sum-total  of  all  forces  which  tend  to  make  tho  aircraft  i 
yaw  to  the  right  or  left.  These  forces  are  of  concern  to  the  pilot  because  he 
must  apply  corrective  rudder  pressures  in  order  to  maintain  desired  flight 
attitudes. 

Training  Commano. — An  Air  Forces  Unit  responsible  for  all  Army  Air  Forces 
Training  activities.  (See  chap.  2.) 

Training  Freeze. — In  this  report,  the  term  "Training  Frcoze”  refers  to  an 
occasion  on  which  students  were  held  at  a  given  level  for  5  additional  weeks  of 
training.  (See  chap.  10.)- 

Turbulence. — Roughness  in  the  air  due  to  vertical  currents.  Severe  turbulence  ; 
is  found  in  thunderstorms  and  is  frequently  violent  enough  to  damage  aircraft. 

UC-78. — Synonymous  with  AT-17. 

Up  Wind. — Into  or  against  tho  wind. 

Validity. — Tho  extent  to  which  a  test  measures  what  it  purports  to  measure. 

Validity  Coefficient. — A  correlation  coefficient  (q.  v.)  which  indicates  how 
successfully  a  test  or  other  selection  device  will  predict  performance  with  respect 
to  a  criterion.  For  example,  tho  correlation  of  a  score  on  a  mcasuro  of  flying 
proficiency  with  whothcr  or  not  a  student  graduates  from  flying  training  will 
give  a  validity  coefficient  indicating  how  well  that  measure  will  predict  gradua-  j 
tion-elimlnation. 

Vertigo. — A  "dizziness”  or  disorientation  experier  jed  by  pilots  flying  at  night  or 
on  instruments  which  causes  them  to  feel  that  they  are  still  turning  aftor  they 
havo  returned  to  straight  and  level  flight. 

Weight. — Tho  rclatlvo  importance  or  value  of  items  entering  into  statistical 
computations.  (See  Weighting.) 

Weioiitino.-— Tho  multiplying  of  different  scores  or  measures  by  different  con¬ 
stants  so  that  tho  contribution  of  each  measure  to  the  total  score  will  bo  propor¬ 
tional  to  its  importance  and  the  total  score  will  havo  maximum  predictive  power. 
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Western  Fltino  Training  Command.— A  regional  branch  of  the  Training 
Command.  (See  chap.  2.) 

Wind  Sock. — A  cloth  bag  mounted  so  as  always  to  be  free  to  swing  with  tho  wind 
and  indicate  the  direction  from  which  the  wind  is  coming. 

Wind  Tee. — A  T-shaped  marker  at  airfields  which  indicates  tho  direction  of 
landing  traffic.  Landings  are  made  parallel  to  the  leg  and  toward  tho  arms  of 
the  T. 

Wino  Loadino. — A  measure  of  the  amount  of  weight  supported  by  each  square 
foot  of  the  wing's  surface.  For  example,  a  wing  of  100  square  feet  on  an  airplane 
grossing  1,000  pounds  would  have  a  wing  loading  of  10  pounds.  For  a  given 
design  of  wing,  the  higher  the  loading,  the  faster  the  stalling  (and  hence  landing) 
speed. 

Work  Adder. — A  mechanical  device  for  stimulating  the  number  or  extensiveness 
of  movements  of  a  control  such  as  throttle,  stick,  or  rudder. 
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Vs.  objective  olwcrvation  77;  358-359 
Work-adder  204-205 

Primary  level  of  training  111-163;  227;  387-408 

Description  and  evaluation  of  specific  measures  128-142 
Item-analysis  studies  121-142 
General  results  125-128 
Purposo  and  procedure  121-125 
Results  on  specific  measures  128-142 
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Ob/ECTivE  Measures  or  Flyiwo  Skill — Continued 
Primary  level  of  training — Continued 
Recommended  check  rido  157-101 
Relation  to  curriculum  111-113 
Summary  101-163 

Recommendations  for  further  work  154-161;  366;  368-309 
Recommended  procedures  for  developing  189-190 
Relationship  among  different  indices  for  goodness  of  362-303 

Ability  to  discriminate  amount  of  training  and  ability  to  predict  pass* 
fail  126-128;  862 

Reliability  and  validity  126-128;  213;  362 
Reliability  of 

Affected  by  heterogeneity  of  items  173-174 

Analysis  of  factors  reducing  142-146;  359-362 

Applicability  of  Spearman-Brown  formula  173-174;  242-245;  309 

AT-6  instrument  items  442-443 

AT-6  instrument  scale  213;  216-217 

Items  tested  at  Primary  level  387-408 

Measures  used  in  training  freeze  studies  460-462 

Method  of  measuring  at  Primary  121-123 

Observers  142-144;  174-178;  186-187;  361 

Odd  v.  even  days  146-151;  192-194 

Primary  level  of  training  125-126;  142-151;  156 

Recommendations  for  further  work  361-362 

Split-half  216-217 

Relationship  to  validity  (6)  20-21;  (15)  10  (6)  126-128;  213;  362 
TB-25  measure*  1  *7-189 
Test-re  test 

Assumptions  may  not  apply  145 
Compared  with  split-half  216-217 

On  samo  compared  with  different  days  142-145;  215-217;  359-360 
Two-engine  flying  186-187 
Scales  composed  of  selected  measures  365r366 
Basic  level  of  instrument  training  333-341 
For  Primary  level  of  training  157-161 
For  TB-25  201;  424-431 
Used  during  training  freezes  445-460 
8corlng 

Comparison  of  different  methods  184-189;  197-198;  364 
Reliability  of:  Sco  Reliability  of,  observer 
Sources  of  variability  122-125;  250-255;  359-362 
Stages  in  development  of  U4r-120 

Primary  level  of  training  113-120  . 

Summary  358-370 

Two-engine  165-170;  181-207;  409-413;  415-431 
TB-25  scale  400-411 

Types  of  measures  developed  and  evaluated  363-364  • 

Validity 

AT-0  instrument  Beale  213;  216-217;  443-444 

Discrimination  of  groups  differing  in  ability  r.  discrimination  of  group* 
differing  in  training  81;  126-127;  362-363 
Items  tested  at  Primary  level  125-126;  150-151;  156;  387-407 
Methods  of  measuring  at  Primary  121-123 
Relationship  between  different  indices  of  126-127;  362-363 
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Objective  Measures  or  Fltino  Skill— Continued 
V  alidity  — Conti  nued 

Relationship  to  reliability  126—127;  213;  302 
Two-engine  instrument  187-188;  195-100 
Pilot  Trainino 

Description  of  9-24 
Instrument  flying  181-182 
Scheduling  19- 17 

Schools,  number  and  distribution  of  13-15 
Standardization,  problem  of  17-  22 
Student  population  15-10 
PrEFLIOHT  9 
Primary  Flyino  School 

General  description  of  9-10 

See  Objective  Measures  or  Flyino  Skill,  Pr‘mary  level  of  training 
Printed  Tests  or  Fltino  Information  203-275;  370-372 

Comparison  of  combat  returnees  with  transition  school  pilots  272 
Experts  consulted  264-205 
General  approach  and  techniques  204-267 
Instrument  Flying  Information  Tests  272-275 

Correlation  with  ground  school  grades  and  pilot  st&nine  273-275 
Reliability  of  273 

P.  D.  C.  Pilot  Information  Test,  Form  1  270-272 
Reliability  of  271-272 
Pilot  Information  Test,  Form  3  267-270 

Comparison  of  pilots,  copilots,  instructors,  and  noninstructors  269-270 
Correlation  with  education,  flying  grades,  and  pilot  stanino  270 
Intercorrclation  of  subsections  268-269 
Reliability  of  269 
Purposes  263-264 

Recommendations  for  further  work  (15)  371-372 
Summary  (12)  275 
Validation  of  267 
Proficiency  Measures 

See  Instructor  Selection,  Fixed  Gunnery,  Objective  Measures  or 
Fltino  Skill,  Subjective  Measures  of  Flyino  Proficiency,  and 
PniNTED  Tests  of  Fltino  Information 
Recommendation,  General  377-380 
Research 

Conditions  needed  for  377-380 
Conditions  of,  in  Army  5-7 
Corps  379-380 

Semi-partial  Correlation  148-149;  194;  423 
Staninb,  Pilot 
Correlation  with 

Fixed  gunnery  257-259 
Flying  Information  tests  270-271;  272-275 
Factor  loading  in  grade-slip  comments  103 

Prediction  of  success  by,  compared  with  that  of  flying  grades  88;  105;  35S 
Reliability  of  86 
Validity  of  86 

Subjective  Measures  of  Flyino  Proficiency  83-109;  357-358;  381-386 
Cheek-ride  grades 

Prediction  of  subsequent  success  by  88-89 
Reliability  of  88-90 
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Subjective  Measures  or  Flyino  Proficiency — Continued 
Comments  appearing  on  daily  grade-stipe  09-104 

Correlation  between  different  levels  of  training  80-89;  91-92;  104-105;  357 
Correlation  with  fixed  gunnery  scores  255-250 
Criterion,  graduation-elimination  84-87 
Daily  grades  (5)  94-104 

Factor  analysis  of  98-104 
Instructors’  comments  99-104 

Intcrcorrclations  among  95-98;  383-384 
Definitions  of  objective  and  subjective  74-77 
Differences  between  schools  84-80;  857 
Elimination  rate,  variability  of  84-80;  357 
Factor  analysis  of  instructors’  comments  98-104;  358-359 
Functions  of  flying  grades  78-74 
Graduation-elimination  84-87 
Halo  effect  358 

Pilot  Rating  Scale,  Forms  A  and  C  104-100 
Intercorrclation  of  items  385 
Prediction  of  subsequent  success  by  104-105 
Pilot  Transition  Training  Record  100-108  ' 

Proficiency  card  90-92 

Prediction  of  subsequent  success  by  91-92 
Sample  of  381-382 
Progress  check  ride  87-90 
Rated  work-sample  75-70;  100-109 
Recommendations  for  further  work  308-309 
Reliability  of  357-358 

Pass-fail  criterion  80-87 
Rated  work-sample  100-109 
Stage  grade  93-94 
Summary  108-109 
Two-engine  160-172 

Validity  of  73;  88-89;  91-92;  104-105;  255-250;  357-358 
Tests 

See  Printed  Tests  or  Flyino  Information  and  Instructor  Evaluation 
and  Selection,  Printed  tests  for  selection 
Trainino  Command  * 

General  description  of  12-15 
Tilainino  Experiments  277-288;  375-377 
Effect  of  type  of  airplane  231-234;  278-285 
Evaluation  of  optical  skeet  sight  285-287 
Recommendations  for  further  work  260;  376-377 
Summary  287-288 
Valuo  of  scientific  design  277 
Trainino  Freeze  Studies  219-235 
Transition  Trainino 

General  description  of  12 

See  Objective  Measures  or  Flyino  Skill,  Multiengine,  Instrument 
Wind,  Flyino  Training  13 
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